[ 503.479853] neutron-nsxv3-agent[61896]: Invalid -W option ignored: invalid action: '"ignore' [ 505.498872] neutron-nsxv3-agent[61896]: INFO neutron.common.config [-] Logging enabled! [ 505.499254] neutron-nsxv3-agent[61896]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev29 [ 505.499455] neutron-nsxv3-agent[61896]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=61896) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 505.499697] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 505.499841] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 505.500812] neutron-nsxv3-agent[61896]: WARNING oslo_policy.policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 505.501047] neutron-nsxv3-agent[61896]: WARNING oslo_policy.policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 505.502274] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 505.518622] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Session token - acquiring [ 505.519447] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.common.locking [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61896) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 505.519667] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 505.519794] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 505.520306] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 505.531020] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 505.833646] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 505.845982] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Activating Management API Provider. [ 505.859122] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Looking for the default Switching Profiles. [ 505.859358] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 505.880996] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Activating Policy API Provider. [ 505.881245] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Looking for the default Infrastructure Rules. [ 505.953348] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Looking for the Default Layer3 Logged Drop Section. [ 505.971039] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 505.971651] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.common.locking [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61896) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 505.971887] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquiring lock "migration-tracking" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 505.972069] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired lock "migration-tracking" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 505.972862] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired external semaphore "migration-tracking" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 505.973109] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Releasing lock "migration-tracking" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 505.973424] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.common.locking [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61896) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 505.973650] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquiring lock "all" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 505.973820] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired lock "all" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 505.974292] neutron-nsxv3-agent[61896]: DEBUG oslo_concurrency.lockutils [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Acquired external semaphore "all" {{(pid=61896) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 505.974787] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.api.rpc [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61896) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 506.020474] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.api.rpc [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61896) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 506.036873] neutron-nsxv3-agent[61896]: DEBUG networking_nsxv3.api.rpc [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61896) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 506.047166] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] Inventory metadata is going to be refreshed. [ 506.047405] neutron-nsxv3-agent[61896]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8bd1a905-0c7c-4d3c-9c32-fa641ddc2cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 506.258335] neutron-nsxv3-agent[62156]: Invalid -W option ignored: invalid action: '"ignore' [ 508.307536] neutron-nsxv3-agent[62156]: INFO neutron.common.config [-] Logging enabled! [ 508.307774] neutron-nsxv3-agent[62156]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev29 [ 508.308082] neutron-nsxv3-agent[62156]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62156) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 508.308314] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 508.308405] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 508.309261] neutron-nsxv3-agent[62156]: WARNING oslo_policy.policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 508.309482] neutron-nsxv3-agent[62156]: WARNING oslo_policy.policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 508.310701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 508.326306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Session token - acquiring [ 508.327113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.327319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 508.327464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 508.327847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 508.337658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 508.624847] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 508.634972] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Activating Management API Provider. [ 508.645858] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Looking for the default Switching Profiles. [ 508.646071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 508.662531] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Activating Policy API Provider. [ 508.662730] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Looking for the default Infrastructure Rules. [ 508.732462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Looking for the Default Layer3 Logged Drop Section. [ 508.748767] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 508.749234] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.749421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 508.749556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 508.749811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 508.749945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 508.750167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.750319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 508.750437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 508.750645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 508.750910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 508.772249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 508.779788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 508.786074] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Inventory metadata is going to be refreshed. [ 508.786228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 509.469764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.470174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.470174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.470521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.482136] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 509.482741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.483496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 509.520490] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.520697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.520826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.521163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.532756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.533657] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:7. [ 509.533805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Outdated resources of Type:SegmentPort Are:{'4bd2709c-b9cf-4614-aef9-a2d33d53a622', 'a2efa773-116e-4490-96a1-72b93834f62c', 'abe87b32-ae3e-4f23-98eb-0a92339209c5', '2e430100-ed24-41f0-b561-a89babe8318a', '5327e964-df36-4553-a55e-5ddd5f213351', '5db7c0e9-6bcc-40b7-ae67-a503a4979385', '8cd1ba7e-bcc9-4baa-afb5-09af82afbad2'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 509.533955] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 509.554504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.554717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.554823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.555142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.555393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.555811] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 509.597364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.597654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.597790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.598103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.598402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.598691] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 509.637718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.638020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.638114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.638475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.638748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.638980] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:1. [ 509.639109] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Outdated resources of Type:Security Group (Rules) Are:{'22e80e7c-32cc-4414-a8d7-6873395a6099'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 509.639236] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 509.659059] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.659270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.659399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.659729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.659884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.660063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 509.660191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 509.660319] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 509.699300] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 509.699537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.699631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.699975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 509.700497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.700717] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 509.700851] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 509.700977] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Inventory metadata have been refreshed. [ 509.701096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Dryrun:True. Metadata refresh completed. [ 509.701236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.702294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] VMware NSXv3 Agent initialized successfully. [ 509.702672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquiring lock "singleton_lock" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 509.702805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Acquired lock "singleton_lock" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 509.703021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Releasing lock "singleton_lock" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 509.703313] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Full set of CONF: {{(pid=62156) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 509.703437] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ******************************************************************************** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} [ 509.703548] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] Configuration options gathered from: {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} [ 509.703664] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} [ 509.703870] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} [ 509.703999] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ================================================================================ {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} [ 509.704198] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] agent_down_time = 75 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.704344] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] allow_automatic_dhcp_failover = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.704483] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] allow_bulk = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.704629] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] api_extensions_path = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.704771] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] api_paste_config = api-paste.ini {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.704914] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] auth_strategy = keystone {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705021] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] backdoor_port = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705127] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] backdoor_socket = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705264] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] backlog = 4096 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705433] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] base_mac = fa:16:3e:00:00:00 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705592] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] bind_host = 0.0.0.0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705739] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] bind_port = 9696 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.705876] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] client_socket_timeout = 900 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706066] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] config_dir = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706132] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706277] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] config_source = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706419] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] control_exchange = neutron {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706562] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] core_plugin = ml2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706703] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] debug = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.706843] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] default_availability_zones = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707055] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707191] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dhcp_agent_notification = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707330] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dhcp_agents_per_network = 1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707496] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dhcp_lease_duration = 86400 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707662] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dhcp_load_type = networks {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707827] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dns_domain = openstacklocal {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.707993] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708157] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_default_route_bfd = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708301] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_default_route_ecmp = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708441] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_dvr = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708582] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_new_agents = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708721] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.708862] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_signals = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709002] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] enable_traditional_dhcp = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709139] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] external_dns_driver = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709277] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] filter_validation = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709427] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] global_physnet_mtu = 8950 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709570] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] graceful_shutdown_timeout = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709765] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] host = cpu-1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.709913] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] host_dvr_for_dhcp = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710055] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] http_retries = 3 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710203] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] instance_format = [instance: %(uuid)s] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710347] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710492] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ipam_driver = internal {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710636] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ipv6_pd_enabled = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710777] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] l3_ha = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.710923] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711167] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] l3_ha_network_physical_name = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711340] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] l3_ha_network_type = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711490] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_config_append = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711638] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711780] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_dir = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.711920] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_file = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712045] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_options = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712189] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_rotate_interval = 1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712337] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_rotate_interval_type = days {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712482] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] log_rotation_type = none {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712595] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712706] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.712853] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713000] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713110] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713252] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_dns_nameservers = 5 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713394] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_header_line = 16384 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713532] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_l3_agents_per_router = 3 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713761] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_logfile_count = 30 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.713928] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_logfile_size_mb = 200 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714071] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] max_subnet_host_routes = 20 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714221] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] my_ip = 10.180.1.21 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714369] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] my_ipv6 = ::1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714512] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] network_auto_schedule = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714650] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] network_link_prefix = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714796] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.714945] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] notify_nova_on_port_data_changes = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715089] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] notify_nova_on_port_status_changes = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715238] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] pagination_max_limit = -1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715381] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] publish_errors = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715574] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rate_limit_burst = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715777] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rate_limit_except_level = CRITICAL {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.715929] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rate_limit_interval = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716086] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] retry_until_window = 30 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716232] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] router_distributed = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716373] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rpc_resources_processing_step = 20 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716517] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rpc_response_max_timeout = 600 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716660] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] rpc_response_timeout = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716803] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] send_events_interval = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.716964] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] service_plugins = ['router'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717113] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] setproctitle = on {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717258] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] state_path = /opt/stack/data/neutron {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717406] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] syslog_log_facility = LOG_USER {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717600] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] tcp_keepidle = 600 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717754] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] transport_url = **** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.717900] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_eventlog = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718041] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_journal = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718178] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_json = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718317] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_ssl = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718454] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_stderr = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718627] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] use_syslog = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718777] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] vlan_transparent = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.718919] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] watch_log_file = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.719060] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] wsgi_default_pool_size = 100 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.719199] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] wsgi_keep_alive = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.719348] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.719492] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] wsgi_server_debug = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 509.719663] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_concurrency.disable_process_locking = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.719851] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.719972] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720132] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720285] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720437] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720584] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720745] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.connection_string = messaging:// {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.720900] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.enabled = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721052] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.es_doc_type = notification {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721195] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.es_scroll_size = 10000 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721344] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.es_scroll_time = 2m {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721489] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.filter_error_trace = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721638] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.hmac_keys = **** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721787] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.sentinel_service_name = mymaster {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.721941] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.socket_timeout = 0.1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722090] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.trace_requests = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722234] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler.trace_sqlalchemy = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722394] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler_jaeger.process_tags = {} {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722539] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler_jaeger.service_name_prefix = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722689] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] profiler_otlp.service_name_prefix = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722848] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.enforce_new_defaults = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.722998] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.enforce_scope = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723156] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.policy_default_rule = default {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723324] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723482] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723640] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723785] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.723927] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724081] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724230] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724386] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724542] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] agent.extensions = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724696] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.724847] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] service_providers.service_provider = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725000] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.default_quota = -1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725154] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725301] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_floatingip = 50 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725459] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_network = 100 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725628] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_port = 500 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725776] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.725921] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_router = 10 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726065] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_security_group = 10 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726213] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726356] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.quota_subnet = 100 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726502] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] QUOTAS.track_quota_usage = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726662] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726808] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.726952] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727103] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727249] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727390] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727598] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727769] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.727916] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728087] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728240] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728384] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_dhcp_release.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728547] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728716] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.728863] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729016] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729165] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729305] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_ovs_vsctl.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729456] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.capabilities = [21] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729602] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729749] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.729899] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730046] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730186] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_namespace.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730335] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.capabilities = [12] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730478] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730619] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730769] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.730915] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731057] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_conntrack.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731206] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.capabilities = [12, 21] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731347] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.group = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731482] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.helper_command = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731632] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731778] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.thread_pool_size = 8 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.731919] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] privsep_link.user = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732096] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732256] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732405] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.continue_on_failed_promotions = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732547] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.dscp = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732694] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.dscp_inherit = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732848] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.force_mp_to_policy = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.732991] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.locking_coordinator_url = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733140] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.log_agent_heartbeats = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733287] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.logging_expire = 1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733440] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733591] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733746] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.polling_interval = 240 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.733898] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734054] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734209] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.report_interval = 30.0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734361] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734515] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734671] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734821] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.sync_skew = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.734969] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.synchronization_queue_size = 20 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735116] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT.use_helper_for_ns_read = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735271] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] SECURITYGROUP.enable_ipset = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735433] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] SECURITYGROUP.enable_security_group = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735615] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735774] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.735929] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] experimental.ipv6_pd_enabled = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736094] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] experimental.linuxbridge = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736262] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.extension_drivers = ['port_security'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736410] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.external_network_type = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736572] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736732] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.overlay_ip_version = 4 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.736886] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.path_mtu = 8950 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737038] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.physical_network_mtus = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737197] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.tenant_network_types = ['vlan'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737354] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737535] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ml2.type_drivers = ['vlan'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737707] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT_CLI.neutron_port_id = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.737855] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738002] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738159] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.mp_to_policy_retry_count = 10 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738305] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.mp_to_policy_retry_sleep = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738448] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738622] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.738860] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739039] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739196] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739348] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739561] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739701] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_login_password = **** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.739861] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_login_port = 443 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740080] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_login_user = admin {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740172] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740328] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740474] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740620] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740773] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.740931] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741083] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741232] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741382] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741533] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741693] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.741902] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742125] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742285] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] vsphere.vsphere_login_password = VMware1! {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742440] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742592] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742747] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.auth_section = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.742905] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.auth_type = password {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743057] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743200] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.certfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743347] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.collect_timing = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743504] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.endpoint_type = public {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743652] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.insecure = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743796] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.keyfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.743948] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.region_name = RegionOne {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744107] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.split_loggers = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744251] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] nova.timeout = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744402] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.auth_section = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744558] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.auth_type = password {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744711] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.744854] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.certfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745003] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.collect_timing = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745156] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.endpoint_type = public {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745301] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.insecure = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745453] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.keyfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745611] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.region_name = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745756] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.split_loggers = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.745897] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] placement.timeout = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746048] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.auth_section = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746192] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.auth_type = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746334] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.cafile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746472] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.certfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746620] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.collect_timing = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746761] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.connect_retries = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.746901] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.connect_retry_delay = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747044] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.enable_notifications = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747187] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.endpoint_override = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747331] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.insecure = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747506] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.interface = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747660] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.keyfile = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747804] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.max_version = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.747944] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.min_version = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748097] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.region_name = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748238] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.retriable_status_codes = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748376] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.service_name = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748556] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.service_type = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748685] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.split_loggers = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748830] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.status_code_retries = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.748972] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.status_code_retry_delay = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749112] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.timeout = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749253] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.valid_interfaces = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749393] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ironic.version = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749543] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] cli_script.dry_run = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749706] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749854] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.749999] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750143] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750286] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750427] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750569] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750714] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.750894] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751063] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751224] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751381] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751627] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751808] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.751958] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752134] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752284] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752433] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752586] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752739] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.752884] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753036] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753179] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753325] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753476] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753629] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753788] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.753943] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754091] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754245] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754401] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754562] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_notifications.driver = [] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754711] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_notifications.retry = -1 {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.754880] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.755028] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 509.755141] neutron-nsxv3-agent[62156]: DEBUG oslo_service.service [None req-99436215-bb17-417d-9889-54a32a604dd0 None None] ******************************************************************************** {{(pid=62156) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} [ 509.756211] neutron-nsxv3-agent[62156]: DEBUG neutron.agent.securitygroups_rpc [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] Init firewall settings (driver=nsxv3) {{(pid=62156) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:124}} [ 509.757579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=62156) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 509.757810] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] RPC agent_id: nsxm-l-01a.corp.local [ 509.759365] neutron-nsxv3-agent[62156]: INFO neutron.agent.agent_extensions_manager [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] Loaded agent extensions: [] [ 509.759910] neutron-nsxv3-agent[62156]: DEBUG neutron_lib.callbacks.manager [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=62156) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 509.821268] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent RPC Daemon Started! [ 509.821268] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:0 started [ 509.821268] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent out of sync with plugin! [ 513.748858] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 513.749258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 518.749666] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 518.750109] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 520.929613] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-ab34e8c0-91dd-4742-9071-179bb264d1e7 None None] Enqueued Resource ID: 5186b424-72f5-44ee-a71e-cd81c2be6c87 with Priority: HIGHEST for action port [ 520.930131] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5186b424-72f5-44ee-a71e-cd81c2be6c87 with Priority: HIGHEST for action port [ 520.930627] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.930760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 520.930828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 520.931127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 520.931209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 520.931362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5186b424-72f5-44ee-a71e-cd81c2be6c87 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.931451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5186b424-72f5-44ee-a71e-cd81c2be6c87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 520.931512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5186b424-72f5-44ee-a71e-cd81c2be6c87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 520.931702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5186b424-72f5-44ee-a71e-cd81c2be6c87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 520.931777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5186b424-72f5-44ee-a71e-cd81c2be6c87',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 520.946143] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5186b424-72f5-44ee-a71e-cd81c2be6c87 [ 520.946382] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.946532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 520.946604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 520.946820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 520.946936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 520.947053] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5186b424-72f5-44ee-a71e-cd81c2be6c87 already deleted. [ 520.947152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5186b424-72f5-44ee-a71e-cd81c2be6c87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 525.930813] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 525.931215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 528.464980] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-68851cb0-77e4-4f61-8cc1-a647ea75772d None None] Enqueued Resource ID: 13dc4afa-07ab-4454-b26c-842c44650c92 with Priority: HIGHEST for action port [ 528.464980] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13dc4afa-07ab-4454-b26c-842c44650c92 with Priority: HIGHEST for action port [ 528.464980] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.464980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.464980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.464980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-13dc4afa-07ab-4454-b26c-842c44650c92 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13dc4afa-07ab-4454-b26c-842c44650c92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13dc4afa-07ab-4454-b26c-842c44650c92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13dc4afa-07ab-4454-b26c-842c44650c92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.465476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13dc4afa-07ab-4454-b26c-842c44650c92',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.551168] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13dc4afa-07ab-4454-b26c-842c44650c92 [ 528.551168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.551168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.551168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.551168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.551569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 528.551569] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13dc4afa-07ab-4454-b26c-842c44650c92 already deleted. [ 528.551569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13dc4afa-07ab-4454-b26c-842c44650c92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 533.464575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.464575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.465391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.465797] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.702998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.703479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 541.703479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 541.703479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 541.703479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 541.703713] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.703924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 541.704020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 541.704163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 541.704392] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.712782] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.718777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.724074] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 541.724155] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 542.314014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.314268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.314268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.314437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.326454] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 542.326871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.327612] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 542.361955] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.362172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.362172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.362358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.374304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.375099] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:7. [ 542.375194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'4bd2709c-b9cf-4614-aef9-a2d33d53a622', 'a2efa773-116e-4490-96a1-72b93834f62c', 'abe87b32-ae3e-4f23-98eb-0a92339209c5', '2e430100-ed24-41f0-b561-a89babe8318a', '5327e964-df36-4553-a55e-5ddd5f213351', '5db7c0e9-6bcc-40b7-ae67-a503a4979385', '8cd1ba7e-bcc9-4baa-afb5-09af82afbad2'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 542.375266] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 542.400379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.400600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.400600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.400783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.400970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.401084] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 542.441387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.441623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.441623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.441790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.442019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.442174] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 542.479394] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.479707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.479707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.479855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.479960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.480133] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:1. [ 542.480221] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'22e80e7c-32cc-4414-a8d7-6873395a6099'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 542.480301] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 542.499677] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.500019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.500019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.500184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.500184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.500309] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 542.500368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 542.500427] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 542.541372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.541707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.541707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.541846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.542202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.542365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 542.542444] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 542.542514] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 542.542572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 7/7 resources of Type:Ports [ 542.542647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bd2709c-b9cf-4614-aef9-a2d33d53a622 with Priority: HIGH for action port [ 542.542726] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2efa773-116e-4490-96a1-72b93834f62c with Priority: HIGH for action port [ 542.542799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abe87b32-ae3e-4f23-98eb-0a92339209c5 with Priority: HIGH for action port [ 542.542868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e430100-ed24-41f0-b561-a89babe8318a with Priority: HIGH for action port [ 542.542941] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5327e964-df36-4553-a55e-5ddd5f213351 with Priority: HIGH for action port [ 542.542998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5db7c0e9-6bcc-40b7-ae67-a503a4979385 with Priority: HIGH for action port [ 542.543054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8cd1ba7e-bcc9-4baa-afb5-09af82afbad2 with Priority: HIGH for action port [ 542.543110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Security Group Rules [ 542.543166] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 with Priority: HIGH for action security_group_rules [ 542.543222] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 542.543283] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 542.543406] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.543513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.543569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.543712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.543786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.543957] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.544066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.544124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.544247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.544323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.544493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.544579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.544633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.544767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.544842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.545042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.545138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.545196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.545330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.545422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.545648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.545745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.545805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.545938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.546013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.546178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.546266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.546321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.546452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.546528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.546690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.546780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.546842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.546965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.547038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.547202] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.547293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.547350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.547504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.547584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.547746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.547830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.547885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.548029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.548105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.548268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.548354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.548409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.548561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.548635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.548800] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.548892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.548951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.549072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.549146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.549307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.549388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.549530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.549673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.549748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.550001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.550097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.550152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.550289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.550355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.550522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.550615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.550672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.550802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.550873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.551033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.551124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.551182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.551309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.551384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.551545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.551626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.551681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.551815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.551884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.552059] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.552149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.552205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.552337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.552408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.552568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.552666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.552725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.552838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.552910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.553105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.553190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.553246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.553378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.553456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.553619] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.553707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.553770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.553893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.553967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.554130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.554219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 542.554274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 542.554402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 542.554476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 542.554733] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:21 [ 542.554802] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 12 of least updated resources [ 542.554885] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbe54746-7678-4d53-a48c-4296311ed287 with Priority: HIGH for action security_group_members [ 542.554963] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ca22c2d-06c1-426d-a9db-59191c5de162 with Priority: HIGH for action security_group_members [ 542.555022] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa with Priority: HIGH for action security_group_members [ 542.555079] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09689ce7-9fbf-4131-8dba-ce23ffc6643c with Priority: HIGH for action security_group_members [ 542.555183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08ac8c4b-f937-4d34-8eed-743f54cd3489 with Priority: HIGH for action security_group_members [ 542.555242] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce8cfc6b-abac-4734-9495-0ecce57fd3c7 with Priority: HIGH for action security_group_members [ 542.555299] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed623266-c23f-4bb3-9f39-bffe44a8263a with Priority: HIGH for action security_group_members [ 542.555358] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a75ec27b-b191-4dd4-9586-aab79b618a32 with Priority: HIGH for action security_group_members [ 542.555416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6b4e118-7564-4a1a-92a9-7fe505a7ad49 with Priority: HIGH for action security_group_members [ 542.555471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 604eb137-a8c4-43b4-a613-889c99722e81 with Priority: HIGH for action security_group_members [ 542.555535] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bba50d22-680e-46f2-9861-e989107886de with Priority: HIGH for action security_group_members [ 542.555592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5e1b636-8399-4d02-8238-f85f3ede0d26 with Priority: HIGH for action security_group_members [ 542.555647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.467165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.467629] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 543.467629] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bd2709c-b9cf-4614-aef9-a2d33d53a622 with Priority: HIGH for action port [ 543.467629] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abe87b32-ae3e-4f23-98eb-0a92339209c5 with Priority: HIGH for action port [ 543.467629] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cd1ba7e-bcc9-4baa-afb5-09af82afbad2 with Priority: HIGH for action port [ 543.467897] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed623266-c23f-4bb3-9f39-bffe44a8263a with Priority: HIGH for action security_group_members [ 543.467897] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e1b636-8399-4d02-8238-f85f3ede0d26 with Priority: HIGH for action security_group_members [ 543.467897] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba50d22-680e-46f2-9861-e989107886de with Priority: HIGH for action security_group_members [ 543.468108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604eb137-a8c4-43b4-a613-889c99722e81 with Priority: HIGH for action security_group_members [ 543.468108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b4e118-7564-4a1a-92a9-7fe505a7ad49 with Priority: HIGH for action security_group_members [ 543.468229] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce8cfc6b-abac-4734-9495-0ecce57fd3c7 with Priority: HIGH for action security_group_members [ 543.468328] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75ec27b-b191-4dd4-9586-aab79b618a32 with Priority: HIGH for action security_group_members [ 543.468420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ac8c4b-f937-4d34-8eed-743f54cd3489 with Priority: HIGH for action security_group_members [ 543.468512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09689ce7-9fbf-4131-8dba-ce23ffc6643c with Priority: HIGH for action security_group_members [ 543.468638] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa with Priority: HIGH for action security_group_members [ 543.468735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca22c2d-06c1-426d-a9db-59191c5de162 with Priority: HIGH for action security_group_members [ 543.468825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe54746-7678-4d53-a48c-4296311ed287 with Priority: HIGH for action security_group_members [ 543.468915] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db7c0e9-6bcc-40b7-ae67-a503a4979385 with Priority: HIGH for action port [ 543.469004] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 with Priority: HIGH for action security_group_rules [ 543.469088] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5327e964-df36-4553-a55e-5ddd5f213351 with Priority: HIGH for action port [ 543.469175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2efa773-116e-4490-96a1-72b93834f62c with Priority: HIGH for action port [ 543.469263] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e430100-ed24-41f0-b561-a89babe8318a with Priority: HIGH for action port [ 543.469590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.469793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.469872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.470085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.470172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.470338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bd2709c-b9cf-4614-aef9-a2d33d53a622 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.470446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bd2709c-b9cf-4614-aef9-a2d33d53a622" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.470510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bd2709c-b9cf-4614-aef9-a2d33d53a622" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.470678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bd2709c-b9cf-4614-aef9-a2d33d53a622" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.470759] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd2709c-b9cf-4614-aef9-a2d33d53a622',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.471695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.471808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.471868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.472029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.472109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.472248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-abe87b32-ae3e-4f23-98eb-0a92339209c5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.472344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abe87b32-ae3e-4f23-98eb-0a92339209c5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.472402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abe87b32-ae3e-4f23-98eb-0a92339209c5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.472549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abe87b32-ae3e-4f23-98eb-0a92339209c5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.472623] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe87b32-ae3e-4f23-98eb-0a92339209c5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.473968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.474046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.474046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.474187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.474263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.474405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cd1ba7e-bcc9-4baa-afb5-09af82afbad2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.474495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cd1ba7e-bcc9-4baa-afb5-09af82afbad2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.474554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cd1ba7e-bcc9-4baa-afb5-09af82afbad2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.474702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cd1ba7e-bcc9-4baa-afb5-09af82afbad2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.474769] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cd1ba7e-bcc9-4baa-afb5-09af82afbad2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.475590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.475705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.475769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.475904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.475982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.476140] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed623266-c23f-4bb3-9f39-bffe44a8263a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.476227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed623266-c23f-4bb3-9f39-bffe44a8263a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.476286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed623266-c23f-4bb3-9f39-bffe44a8263a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.476453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed623266-c23f-4bb3-9f39-bffe44a8263a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.476596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.476683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.476739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.476876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.476955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.477033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed623266-c23f-4bb3-9f39-bffe44a8263a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.477849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.477963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.478021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.478154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.478302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.478490] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5e1b636-8399-4d02-8238-f85f3ede0d26 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.478607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5e1b636-8399-4d02-8238-f85f3ede0d26" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.478675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5e1b636-8399-4d02-8238-f85f3ede0d26" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.478830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5e1b636-8399-4d02-8238-f85f3ede0d26" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.478970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.479064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.479122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.479257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.479335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.479415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5e1b636-8399-4d02-8238-f85f3ede0d26',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.480262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.480390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.480476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.480645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.480728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.480881] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-bba50d22-680e-46f2-9861-e989107886de taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.480994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bba50d22-680e-46f2-9861-e989107886de" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.481055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bba50d22-680e-46f2-9861-e989107886de" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.481216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bba50d22-680e-46f2-9861-e989107886de" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.481352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.481467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.481566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.481747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.481843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.481967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bba50d22-680e-46f2-9861-e989107886de',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.482894] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.483023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.483096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.483257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.483337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.483488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-604eb137-a8c4-43b4-a613-889c99722e81 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.483608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-604eb137-a8c4-43b4-a613-889c99722e81" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.483668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-604eb137-a8c4-43b4-a613-889c99722e81" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.483871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-604eb137-a8c4-43b4-a613-889c99722e81" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.484033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.484144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.484215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.484353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.484441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.484531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('604eb137-a8c4-43b4-a613-889c99722e81',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.485349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.485461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.485525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.485672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.485787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.485944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b4e118-7564-4a1a-92a9-7fe505a7ad49 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.486037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b4e118-7564-4a1a-92a9-7fe505a7ad49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.486096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b4e118-7564-4a1a-92a9-7fe505a7ad49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.486258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b4e118-7564-4a1a-92a9-7fe505a7ad49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.486393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.486486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.486544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.486671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.486748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.486828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b4e118-7564-4a1a-92a9-7fe505a7ad49',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.487633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.487743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.487803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.487954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.488041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.488199] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce8cfc6b-abac-4734-9495-0ecce57fd3c7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.488303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce8cfc6b-abac-4734-9495-0ecce57fd3c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.488444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce8cfc6b-abac-4734-9495-0ecce57fd3c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.488637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce8cfc6b-abac-4734-9495-0ecce57fd3c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.488788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.488885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.488945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.489079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.489156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.489237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce8cfc6b-abac-4734-9495-0ecce57fd3c7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.490231] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.490341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.490409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.490558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.490658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.490834] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a75ec27b-b191-4dd4-9586-aab79b618a32 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.490933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a75ec27b-b191-4dd4-9586-aab79b618a32" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.491013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a75ec27b-b191-4dd4-9586-aab79b618a32" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.491215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a75ec27b-b191-4dd4-9586-aab79b618a32" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.491388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.491514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.491577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.491774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.491862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.491949] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a75ec27b-b191-4dd4-9586-aab79b618a32',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.492895] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.493004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.493090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.493251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.493331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.493474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-08ac8c4b-f937-4d34-8eed-743f54cd3489 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.493563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08ac8c4b-f937-4d34-8eed-743f54cd3489" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.493632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08ac8c4b-f937-4d34-8eed-743f54cd3489" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.493784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08ac8c4b-f937-4d34-8eed-743f54cd3489" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.493924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.494016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.494076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.494233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.494313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.494395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08ac8c4b-f937-4d34-8eed-743f54cd3489',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.494612] neutron-nsxv3-agent[62156]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 543.495274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.495392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.495454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.495606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.495687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.495825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-09689ce7-9fbf-4131-8dba-ce23ffc6643c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.495917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09689ce7-9fbf-4131-8dba-ce23ffc6643c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.495994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09689ce7-9fbf-4131-8dba-ce23ffc6643c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.496173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09689ce7-9fbf-4131-8dba-ce23ffc6643c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.496320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.496430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.496488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.496640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.496723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.496807] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09689ce7-9fbf-4131-8dba-ce23ffc6643c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.497698] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.497812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.497876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.498027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.498104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.498243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.498327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.498386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.498662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.498798] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.498893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.498952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.499081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.499157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.499234] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.499988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.500176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.500246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.500396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.500474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.500629] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca22c2d-06c1-426d-a9db-59191c5de162 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.500745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca22c2d-06c1-426d-a9db-59191c5de162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.500809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca22c2d-06c1-426d-a9db-59191c5de162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.500970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca22c2d-06c1-426d-a9db-59191c5de162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.501108] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.501203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.501261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.501396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.501483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.501580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca22c2d-06c1-426d-a9db-59191c5de162',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.502341] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.502449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.502519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.502667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.502777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.502905] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe54746-7678-4d53-a48c-4296311ed287 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.502999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe54746-7678-4d53-a48c-4296311ed287" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.503058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe54746-7678-4d53-a48c-4296311ed287" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.503214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe54746-7678-4d53-a48c-4296311ed287" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.503347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.503440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.503516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.503629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.503705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.503783] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe54746-7678-4d53-a48c-4296311ed287',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.504553] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.504680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.504746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.504896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.504996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.505172] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db7c0e9-6bcc-40b7-ae67-a503a4979385 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.505295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db7c0e9-6bcc-40b7-ae67-a503a4979385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.505369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db7c0e9-6bcc-40b7-ae67-a503a4979385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.505567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db7c0e9-6bcc-40b7-ae67-a503a4979385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.505642] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db7c0e9-6bcc-40b7-ae67-a503a4979385',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.506528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.506667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.506735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.506917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.506999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.507268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22e80e7c-32cc-4414-a8d7-6873395a6099 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.507377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.507442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.507626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.507692] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22e80e7c-32cc-4414-a8d7-6873395a6099',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.508472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.508691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.508767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.508917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.508997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.509138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5327e964-df36-4553-a55e-5ddd5f213351 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.509251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5327e964-df36-4553-a55e-5ddd5f213351" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.509336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5327e964-df36-4553-a55e-5ddd5f213351" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.509506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5327e964-df36-4553-a55e-5ddd5f213351" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.509576] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5327e964-df36-4553-a55e-5ddd5f213351',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.510424] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.510544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.510619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.510768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.510834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.510979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2efa773-116e-4490-96a1-72b93834f62c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.511065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2efa773-116e-4490-96a1-72b93834f62c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.511120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2efa773-116e-4490-96a1-72b93834f62c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.511277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2efa773-116e-4490-96a1-72b93834f62c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.511341] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2efa773-116e-4490-96a1-72b93834f62c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.513184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.513294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.513361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.513509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.513589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.513758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e430100-ed24-41f0-b561-a89babe8318a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.513847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e430100-ed24-41f0-b561-a89babe8318a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.513906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e430100-ed24-41f0-b561-a89babe8318a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.514090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e430100-ed24-41f0-b561-a89babe8318a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.514159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e430100-ed24-41f0-b561-a89babe8318a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.519030] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bd2709c-b9cf-4614-aef9-a2d33d53a622 [ 543.519223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.519328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.519399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.519556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.519644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.563927] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2efa773-116e-4490-96a1-72b93834f62c [ 543.564164] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.564300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.564373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.564615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.564725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.593218] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e430100-ed24-41f0-b561-a89babe8318a [ 543.593352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.593419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.593455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.593706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.593808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.601813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.601994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.602035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.602219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.602313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.602511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.602620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.602698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.602825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.602902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.602989] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca22c2d-06c1-426d-a9db-59191c5de162 is going to be deleted. [ 543.614177] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5db7c0e9-6bcc-40b7-ae67-a503a4979385 [ 543.614384] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.614514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.614555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.614731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.614821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.637899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.638087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.638125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.638309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.638404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.638589] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.638710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.638750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.638898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.638977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.639063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 604eb137-a8c4-43b4-a613-889c99722e81 is going to be deleted. [ 543.649185] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.649367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.649401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.649830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.650000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.650375] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.650509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.650580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.650755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.650838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.650929] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a75ec27b-b191-4dd4-9586-aab79b618a32 is going to be deleted. [ 543.652326] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cd1ba7e-bcc9-4baa-afb5-09af82afbad2 [ 543.652668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.652819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.652890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.653053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.653141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.655793] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.655921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.656015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.656140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.656224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.656318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca22c2d-06c1-426d-a9db-59191c5de162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.658209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abe87b32-ae3e-4f23-98eb-0a92339209c5 [ 543.658376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.658500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.658581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.658743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.658831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.661358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.661494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.661529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.661670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.661748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.661871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2efa773-116e-4490-96a1-72b93834f62c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.663117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.663235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.663306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.663488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.663572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.663694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e430100-ed24-41f0-b561-a89babe8318a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.664325] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.664460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.664532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.664680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.664777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.664911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bd2709c-b9cf-4614-aef9-a2d33d53a622" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.665178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.665278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.665340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.665507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.665591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.665772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.665868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.665906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.666039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.666115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.666198] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08ac8c4b-f937-4d34-8eed-743f54cd3489 is going to be deleted. [ 543.672015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.672179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.672243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.672387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.676586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.676708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.676934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.677025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.677285] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.677377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.677605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.677681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.677890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.677971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.678161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.678243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.678431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.678509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.678696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.678773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.678907] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5327e964-df36-4553-a55e-5ddd5f213351 [ 543.679046] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.679140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.679199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.679357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.679437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.682043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.682147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.682210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.682369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.682452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.682545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-604eb137-a8c4-43b4-a613-889c99722e81" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.701399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.701564] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 is going to be deleted. [ 543.702519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.702739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.702833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.703048] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.703280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.703351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.703507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.703592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.703681] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09689ce7-9fbf-4131-8dba-ce23ffc6643c is going to be deleted. [ 543.708202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.708470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.708603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.708770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.708880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.708957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.709089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.709192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.709280] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b4e118-7564-4a1a-92a9-7fe505a7ad49 is going to be deleted. [ 543.710807] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.710913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.710976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.711244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.711331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.711452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db7c0e9-6bcc-40b7-ae67-a503a4979385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.712142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.712253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.712321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.712472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.712555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.712646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a75ec27b-b191-4dd4-9586-aab79b618a32" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.713283] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.713476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.713566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.713717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.713800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.713893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08ac8c4b-f937-4d34-8eed-743f54cd3489" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.714024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.714165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.714245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.714415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.714511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.714575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.714711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.714787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.714869] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bba50d22-680e-46f2-9861-e989107886de is going to be deleted. [ 543.716853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.717013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.717103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.717306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.717375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.717436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.717603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.717681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.717765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe54746-7678-4d53-a48c-4296311ed287 is going to be deleted. [ 543.718741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.718917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.719013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.719195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.719294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.719359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.719504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.719584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.719670] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa is going to be deleted. [ 543.720671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.720831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.720919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.721094] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.721316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.721383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.721525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.721602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.721686] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5e1b636-8399-4d02-8238-f85f3ede0d26 is going to be deleted. [ 543.723111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.723275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.723363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.723641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.723760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.723828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.723972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.724066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.724151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce8cfc6b-abac-4734-9495-0ecce57fd3c7 is going to be deleted. [ 543.727235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.727436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.727543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.727755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.727869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.727926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.728106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.728187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.728274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed623266-c23f-4bb3-9f39-bffe44a8263a is going to be deleted. [ 543.765026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.765234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.765234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.765462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.765552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.765690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5327e964-df36-4553-a55e-5ddd5f213351" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.766505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.766627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.766699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.766884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.766970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.767095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abe87b32-ae3e-4f23-98eb-0a92339209c5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.770395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.770555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.770594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.770737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.770822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.770948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cd1ba7e-bcc9-4baa-afb5-09af82afbad2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.814558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.814784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.814784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.814986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.815193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.815323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed623266-c23f-4bb3-9f39-bffe44a8263a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.816536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.816655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.816725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.816908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.816992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.817093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bba50d22-680e-46f2-9861-e989107886de" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.817800] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.817910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.817981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.818144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.818227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.818325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09689ce7-9fbf-4131-8dba-ce23ffc6643c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.829108] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.829293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.829333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.829520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.829613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.829713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5e1b636-8399-4d02-8238-f85f3ede0d26" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.837510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.837707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.837707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.837924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.838012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.838113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce8cfc6b-abac-4734-9495-0ecce57fd3c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.838881] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.838995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.839065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.839230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.839311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.839404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b4e118-7564-4a1a-92a9-7fe505a7ad49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.840968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.841083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.841128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.841289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.841374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.841471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe54746-7678-4d53-a48c-4296311ed287" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.846404] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 543.846825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.846948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.847017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.847197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.847282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.847394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1a2a07-3c3c-482e-ae97-fa99f1ef22aa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.849785] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 543.850178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.850295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 543.850362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 543.850589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 543.850682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 543.850798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 548.470744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.471183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.472118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.472481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.473547] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.473918] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.475019] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.475019] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.476311] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.476553] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.591058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1b11fff5-3f89-4a77-b32d-2755fcb63505 None None] Enqueued Resource ID: 7d7fe328-c8f4-4906-aba2-0789af437272 with Priority: HIGHEST for action port [ 568.591058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d7fe328-c8f4-4906-aba2-0789af437272 with Priority: HIGHEST for action port [ 568.591058] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.591058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 568.591058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 568.591058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d7fe328-c8f4-4906-aba2-0789af437272 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d7fe328-c8f4-4906-aba2-0789af437272" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d7fe328-c8f4-4906-aba2-0789af437272" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d7fe328-c8f4-4906-aba2-0789af437272" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 568.591344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d7fe328-c8f4-4906-aba2-0789af437272',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.600988] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d7fe328-c8f4-4906-aba2-0789af437272 [ 568.601244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.601409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 568.601507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 568.601738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 568.601860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 568.601982] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d7fe328-c8f4-4906-aba2-0789af437272 already deleted. [ 568.602091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d7fe328-c8f4-4906-aba2-0789af437272" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 570.869558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-82f9362e-5445-409e-b884-0481f0f7f849 None None] Enqueued Resource ID: 2e7f2a3c-51e1-4a4d-aaee-af330807252d with Priority: HIGHEST for action port [ 570.869835] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7f2a3c-51e1-4a4d-aaee-af330807252d with Priority: HIGHEST for action port [ 570.870323] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.870437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 570.870510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 570.870701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 570.870780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 570.870927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e7f2a3c-51e1-4a4d-aaee-af330807252d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.871022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e7f2a3c-51e1-4a4d-aaee-af330807252d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 570.871068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e7f2a3c-51e1-4a4d-aaee-af330807252d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 570.871247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e7f2a3c-51e1-4a4d-aaee-af330807252d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 570.871319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e7f2a3c-51e1-4a4d-aaee-af330807252d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.919031] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e7f2a3c-51e1-4a4d-aaee-af330807252d [ 570.919257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.919385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 570.919454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 570.919665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 570.919757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 570.919858] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e7f2a3c-51e1-4a4d-aaee-af330807252d already deleted. [ 570.919938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e7f2a3c-51e1-4a4d-aaee-af330807252d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 571.101415] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e24b6535-75c5-4aa9-b9ee-299a3b8a07e8 None None] Enqueued Resource ID: c927072a-ff71-40ec-9ef3-7eda27d0ea4c with Priority: HIGHEST for action port [ 571.102277] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c927072a-ff71-40ec-9ef3-7eda27d0ea4c with Priority: HIGHEST for action port [ 571.102649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.102799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 571.102876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 571.103093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 571.103186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 571.103343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-c927072a-ff71-40ec-9ef3-7eda27d0ea4c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.103438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c927072a-ff71-40ec-9ef3-7eda27d0ea4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 571.103504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c927072a-ff71-40ec-9ef3-7eda27d0ea4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 571.103687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c927072a-ff71-40ec-9ef3-7eda27d0ea4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 571.103766] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c927072a-ff71-40ec-9ef3-7eda27d0ea4c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.154676] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c927072a-ff71-40ec-9ef3-7eda27d0ea4c [ 571.154676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.154676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 571.154676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 571.154676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 571.154911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 571.154911] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c927072a-ff71-40ec-9ef3-7eda27d0ea4c already deleted. [ 571.154911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c927072a-ff71-40ec-9ef3-7eda27d0ea4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.076605] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-39ce9ed7-8526-4d49-a237-feb2d93994b6 None None] Enqueued Resource ID: f380417a-e9dd-437d-b661-fcac917aad99 with Priority: HIGHEST for action port [ 574.076605] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f380417a-e9dd-437d-b661-fcac917aad99 with Priority: HIGHEST for action port [ 574.076605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.076605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.076605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.076605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.076996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.076996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f380417a-e9dd-437d-b661-fcac917aad99 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.076996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f380417a-e9dd-437d-b661-fcac917aad99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.076996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f380417a-e9dd-437d-b661-fcac917aad99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.077156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f380417a-e9dd-437d-b661-fcac917aad99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.077230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f380417a-e9dd-437d-b661-fcac917aad99',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.095391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f380417a-e9dd-437d-b661-fcac917aad99 [ 574.095663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.095798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.095883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.096119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.096208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.096302] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f380417a-e9dd-437d-b661-fcac917aad99 already deleted. [ 574.096381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f380417a-e9dd-437d-b661-fcac917aad99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.542649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e8fc7da2-9987-4e26-9278-5962274e124a None None] Enqueued Resource ID: 240c5218-e035-4e14-9d7e-e8bcb3918bdf with Priority: HIGHEST for action port [ 574.542919] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240c5218-e035-4e14-9d7e-e8bcb3918bdf with Priority: HIGHEST for action port [ 574.543555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.543678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.543744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-240c5218-e035-4e14-9d7e-e8bcb3918bdf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240c5218-e035-4e14-9d7e-e8bcb3918bdf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240c5218-e035-4e14-9d7e-e8bcb3918bdf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.544650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240c5218-e035-4e14-9d7e-e8bcb3918bdf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.544962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240c5218-e035-4e14-9d7e-e8bcb3918bdf',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.596062] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 240c5218-e035-4e14-9d7e-e8bcb3918bdf [ 574.596139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.596238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 574.596320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 574.596482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 574.596568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 574.596659] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:240c5218-e035-4e14-9d7e-e8bcb3918bdf already deleted. [ 574.596735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240c5218-e035-4e14-9d7e-e8bcb3918bdf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.471618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0d0867a3-a5bb-401d-935f-ab866262d437 None None] Enqueued Resource ID: 940b174a-49c2-4b51-b0dd-5c350400158d with Priority: HIGHEST for action port [ 576.471618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940b174a-49c2-4b51-b0dd-5c350400158d with Priority: HIGHEST for action port [ 576.471618] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.471618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.471618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.471618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-940b174a-49c2-4b51-b0dd-5c350400158d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940b174a-49c2-4b51-b0dd-5c350400158d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940b174a-49c2-4b51-b0dd-5c350400158d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940b174a-49c2-4b51-b0dd-5c350400158d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.472134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940b174a-49c2-4b51-b0dd-5c350400158d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.529035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 940b174a-49c2-4b51-b0dd-5c350400158d [ 576.529254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.529380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.529442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.529676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.529757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.529851] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:940b174a-49c2-4b51-b0dd-5c350400158d already deleted. [ 576.529930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940b174a-49c2-4b51-b0dd-5c350400158d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.612810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2b2bfffe-6190-4f75-a345-e05d7fa9ee30 None None] Enqueued Resource ID: ad0622df-e4ab-476f-8035-5b00ba681ef5 with Priority: HIGHEST for action port [ 576.612810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad0622df-e4ab-476f-8035-5b00ba681ef5 with Priority: HIGHEST for action port [ 576.612810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.612810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.612810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.613099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.613099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.613157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad0622df-e4ab-476f-8035-5b00ba681ef5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.613292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad0622df-e4ab-476f-8035-5b00ba681ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.613357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad0622df-e4ab-476f-8035-5b00ba681ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.613713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad0622df-e4ab-476f-8035-5b00ba681ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.613713] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0622df-e4ab-476f-8035-5b00ba681ef5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.669162] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad0622df-e4ab-476f-8035-5b00ba681ef5 [ 576.669420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.669558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 576.669631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 576.669841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 576.669930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 576.670024] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad0622df-e4ab-476f-8035-5b00ba681ef5 already deleted. [ 576.670103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad0622df-e4ab-476f-8035-5b00ba681ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 577.782811] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-ddba08eb-2fb2-48ea-97a0-27e510f9c87d None None] Enqueued Resource ID: 334ef52c-64a7-4131-b633-b2abdd8f5ee3 with Priority: HIGHEST for action port [ 577.783095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334ef52c-64a7-4131-b633-b2abdd8f5ee3 with Priority: HIGHEST for action port [ 577.783557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.783677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 577.783742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 577.783934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 577.784027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 577.784178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-334ef52c-64a7-4131-b633-b2abdd8f5ee3 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.784270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334ef52c-64a7-4131-b633-b2abdd8f5ee3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 577.784323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334ef52c-64a7-4131-b633-b2abdd8f5ee3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 577.784525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334ef52c-64a7-4131-b633-b2abdd8f5ee3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 577.784599] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334ef52c-64a7-4131-b633-b2abdd8f5ee3',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.801824] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334ef52c-64a7-4131-b633-b2abdd8f5ee3 [ 577.802033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.802157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 577.802223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 577.802422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 577.802504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 577.802593] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334ef52c-64a7-4131-b633-b2abdd8f5ee3 already deleted. [ 577.802668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334ef52c-64a7-4131-b633-b2abdd8f5ee3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 578.171740] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-4de7b317-0571-45d5-b091-0ee84123a8f3 None None] Enqueued Resource ID: ba6370ea-7741-40ab-8800-6b66328e2e74 with Priority: HIGHEST for action port [ 578.171984] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6370ea-7741-40ab-8800-6b66328e2e74 with Priority: HIGHEST for action port [ 578.172649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.172846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.172846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.173079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.173192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 578.173379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba6370ea-7741-40ab-8800-6b66328e2e74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.173508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba6370ea-7741-40ab-8800-6b66328e2e74" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.173635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba6370ea-7741-40ab-8800-6b66328e2e74" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.173786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba6370ea-7741-40ab-8800-6b66328e2e74" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.173872] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6370ea-7741-40ab-8800-6b66328e2e74',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.212803] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba6370ea-7741-40ab-8800-6b66328e2e74 [ 578.212989] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.213159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.213212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.213381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.213493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 578.213590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba6370ea-7741-40ab-8800-6b66328e2e74 already deleted. [ 578.213636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba6370ea-7741-40ab-8800-6b66328e2e74" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.066595] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a97b2e49-2118-402e-ae5f-8300c06c95ec None None] Enqueued Resource ID: 7db4eaef-dd16-4c9a-8650-e732cd3f1c00 with Priority: HIGHEST for action port [ 581.067275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db4eaef-dd16-4c9a-8650-e732cd3f1c00 with Priority: HIGHEST for action port [ 581.067647] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.067776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.067842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.068081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.068160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.068285] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7db4eaef-dd16-4c9a-8650-e732cd3f1c00 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.068381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7db4eaef-dd16-4c9a-8650-e732cd3f1c00" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.068645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7db4eaef-dd16-4c9a-8650-e732cd3f1c00" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.068645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7db4eaef-dd16-4c9a-8650-e732cd3f1c00" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.068748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7db4eaef-dd16-4c9a-8650-e732cd3f1c00',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.105818] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7db4eaef-dd16-4c9a-8650-e732cd3f1c00 [ 581.105870] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.105964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.106026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.106226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.106313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.106402] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7db4eaef-dd16-4c9a-8650-e732cd3f1c00 already deleted. [ 581.106479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7db4eaef-dd16-4c9a-8650-e732cd3f1c00" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.248668] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0ac8032a-5a5e-41dc-ab56-b0cf1b402774 None None] Enqueued Resource ID: f0764e1a-48ef-44d9-8e80-4bf92a22bf1f with Priority: HIGHEST for action port [ 582.248935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0764e1a-48ef-44d9-8e80-4bf92a22bf1f with Priority: HIGHEST for action port [ 582.249531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.249635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.249676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.249840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.249957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.250058] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0764e1a-48ef-44d9-8e80-4bf92a22bf1f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.250148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0764e1a-48ef-44d9-8e80-4bf92a22bf1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.250205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0764e1a-48ef-44d9-8e80-4bf92a22bf1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.250387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0764e1a-48ef-44d9-8e80-4bf92a22bf1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.250467] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0764e1a-48ef-44d9-8e80-4bf92a22bf1f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.298720] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0764e1a-48ef-44d9-8e80-4bf92a22bf1f [ 582.298720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.298720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.298720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.298720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.298946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.298946] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0764e1a-48ef-44d9-8e80-4bf92a22bf1f already deleted. [ 582.298946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0764e1a-48ef-44d9-8e80-4bf92a22bf1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.016335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-ceb21bd7-542f-44ca-bcc6-954309a06412 None None] Enqueued Resource ID: 7f8dbe70-e457-42cc-8c36-a1f67bfdda54 with Priority: HIGHEST for action port [ 583.016833] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8dbe70-e457-42cc-8c36-a1f67bfdda54 with Priority: HIGHEST for action port [ 583.017135] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.017255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.017319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.017538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.017622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.017780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f8dbe70-e457-42cc-8c36-a1f67bfdda54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.017893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f8dbe70-e457-42cc-8c36-a1f67bfdda54" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.017953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f8dbe70-e457-42cc-8c36-a1f67bfdda54" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.018159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f8dbe70-e457-42cc-8c36-a1f67bfdda54" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.018235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f8dbe70-e457-42cc-8c36-a1f67bfdda54',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.079935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f8dbe70-e457-42cc-8c36-a1f67bfdda54 [ 583.079935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.079935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.079935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.079935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.080292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.080292] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f8dbe70-e457-42cc-8c36-a1f67bfdda54 already deleted. [ 583.080292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f8dbe70-e457-42cc-8c36-a1f67bfdda54" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.320512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-45e06b41-b155-4e17-a1aa-c70ca9d43250 None None] Enqueued Resource ID: b310c5ee-9176-47f0-89e5-e0cf2d258fa0 with Priority: HIGHEST for action port [ 583.320512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b310c5ee-9176-47f0-89e5-e0cf2d258fa0 with Priority: HIGHEST for action port [ 583.320512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.320512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.320512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.320512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b310c5ee-9176-47f0-89e5-e0cf2d258fa0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b310c5ee-9176-47f0-89e5-e0cf2d258fa0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b310c5ee-9176-47f0-89e5-e0cf2d258fa0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b310c5ee-9176-47f0-89e5-e0cf2d258fa0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.321005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b310c5ee-9176-47f0-89e5-e0cf2d258fa0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.341520] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b310c5ee-9176-47f0-89e5-e0cf2d258fa0 [ 583.341742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.341875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 583.341944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 583.342150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 583.342239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 583.342333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b310c5ee-9176-47f0-89e5-e0cf2d258fa0 already deleted. [ 583.342411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b310c5ee-9176-47f0-89e5-e0cf2d258fa0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.900531] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22dca4e6-6372-4c46-acaf-fc503ad7f5b0 req-802122d8-4fa9-4e1f-a5a4-67946dad6f97 tempest-FloatingIPsAssociationNegativeTestJSON-743228547 tempest-FloatingIPsAssociationNegativeTestJSON-743228547-project-member] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 584.900531] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 584.900531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.900531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.900531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.900851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.901040] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.901040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.901040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.901040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.901040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.901197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.937004] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.937152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.937248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.937443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.937560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.937769] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.937878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.937942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.938101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.938180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.938266] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 already deleted. [ 584.938347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 585.496980] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-f6e4dc33-733b-4306-8058-b437e8e41545 None None] Enqueued Resource ID: 1408a0c1-ff7b-479d-91b0-2e2d1b771a91 with Priority: HIGHEST for action port [ 585.497235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1408a0c1-ff7b-479d-91b0-2e2d1b771a91 with Priority: HIGHEST for action port [ 585.497865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.498028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 585.498063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 585.498237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 585.498317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 585.498473] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1408a0c1-ff7b-479d-91b0-2e2d1b771a91 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.498576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1408a0c1-ff7b-479d-91b0-2e2d1b771a91" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 585.498641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1408a0c1-ff7b-479d-91b0-2e2d1b771a91" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 585.498829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1408a0c1-ff7b-479d-91b0-2e2d1b771a91" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 585.498903] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1408a0c1-ff7b-479d-91b0-2e2d1b771a91',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.534674] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1408a0c1-ff7b-479d-91b0-2e2d1b771a91 [ 585.534895] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.535026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 585.535093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 585.535296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 585.535387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 585.535487] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1408a0c1-ff7b-479d-91b0-2e2d1b771a91 already deleted. [ 585.535571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1408a0c1-ff7b-479d-91b0-2e2d1b771a91" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.041040] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-9e2885f0-382c-444d-9c71-ff0848070f95 req-4c621be2-0821-459a-88b9-849bb8697dd1 tempest-FloatingIPsAssociationTestJSON-830652871 tempest-FloatingIPsAssociationTestJSON-830652871-project-member] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 587.041574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 587.041898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.042026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.042096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.042355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.042402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.042564] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.042672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.042737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.042929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.043079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.043174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.043236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.043393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.043480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.043572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.054665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.054935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.055016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.055349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.055518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.055749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.055845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.055896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.056089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.056170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.056255] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5054886e-af25-43c4-9482-725da5a36a84 already deleted. [ 587.056330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.088905] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.089135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.089243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.089508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.089650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.089915] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-537 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.090077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-537" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.090200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-537" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.090461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-537" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.090714] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.090876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.091000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.091209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.091352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.091504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-537" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.091776] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.091931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.092053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.092265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.092402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.092646] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-d7594078-ff8d-4833-9397-153721382251 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.092806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.092928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.093177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.093316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7594078-ff8d-4833-9397-153721382251',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.120170] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.120386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.120514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.120819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.120978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.121149] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port d7594078-ff8d-4833-9397-153721382251 not found, creating... [ 587.121422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.121598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.121720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.121945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.122086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.122459] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.122608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.122725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.122931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.123064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.123202] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: d7594078-ff8d-4833-9397-153721382251 is going to be created. [ 587.150538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.150538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.150794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.150944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.151179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.151417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.759885] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2e0afc1c-9768-4cf4-a5db-43e443833107 tempest-ServersTestBootFromVolume-245018572 tempest-ServersTestBootFromVolume-245018572-project-member] Enqueued Resource ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e with Priority: HIGHEST for action security_group_rules [ 587.763132] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e with Priority: HIGHEST for action security_group_rules [ 587.763132] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-50e433ff-520f-4d08-b385-c4a2022159e1 None None] Enqueued Resource ID: ed6f8dc7-3e3e-4d50-9bed-306c69900190 with Priority: HIGHEST for action port [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.763132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.763753] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db9f3a6-c031-4908-b545-1cde64e5cb4e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.764156] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6f8dc7-3e3e-4d50-9bed-306c69900190 with Priority: HIGHEST for action port [ 587.764615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.764725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.764779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.764957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.765019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.765160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed6f8dc7-3e3e-4d50-9bed-306c69900190 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.765246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed6f8dc7-3e3e-4d50-9bed-306c69900190" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.765886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed6f8dc7-3e3e-4d50-9bed-306c69900190" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.765886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed6f8dc7-3e3e-4d50-9bed-306c69900190" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.765886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed6f8dc7-3e3e-4d50-9bed-306c69900190',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.800139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed6f8dc7-3e3e-4d50-9bed-306c69900190 [ 587.800376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.800500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.800544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.800807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.800848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.800923] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed6f8dc7-3e3e-4d50-9bed-306c69900190 already deleted. [ 587.801021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed6f8dc7-3e3e-4d50-9bed-306c69900190" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.842983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.843134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 587.843208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 587.843461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 587.843605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 587.843646] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e already deleted. [ 587.843749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.413457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-84bb7ad7-6bbd-4ae9-a1f2-3022b746f665 tempest-ServersTestBootFromVolume-245018572 tempest-ServersTestBootFromVolume-245018572-project-member] Enqueued Resource ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e with Priority: HIGHEST for action security_group_rules [ 588.413997] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e with Priority: HIGHEST for action security_group_rules [ 588.414308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.414444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.414504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.414699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.414782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.414935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.415021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.415082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.415220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.415306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db9f3a6-c031-4908-b545-1cde64e5cb4e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.512036] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.512036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.512210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.512375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.512429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.512509] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db9f3a6-c031-4908-b545-1cde64e5cb4e already deleted. [ 588.512592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db9f3a6-c031-4908-b545-1cde64e5cb4e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.561262] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a876f67e-bc9b-4a8c-972e-b7e7bfee963b None None] Enqueued Resource ID: 1ad77a1b-9e42-4863-8486-21d262e87d5a with Priority: HIGHEST for action port [ 588.561441] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ad77a1b-9e42-4863-8486-21d262e87d5a with Priority: HIGHEST for action port [ 588.562097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.562226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.562358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.562513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.562598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.562757] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ad77a1b-9e42-4863-8486-21d262e87d5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.562855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ad77a1b-9e42-4863-8486-21d262e87d5a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.562917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ad77a1b-9e42-4863-8486-21d262e87d5a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.563099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ad77a1b-9e42-4863-8486-21d262e87d5a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.563179] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ad77a1b-9e42-4863-8486-21d262e87d5a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.647242] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ad77a1b-9e42-4863-8486-21d262e87d5a [ 588.647560] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.647752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.647807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.648228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.648228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.648228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ad77a1b-9e42-4863-8486-21d262e87d5a already deleted. [ 588.648356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ad77a1b-9e42-4863-8486-21d262e87d5a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.825545] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22dca4e6-6372-4c46-acaf-fc503ad7f5b0 req-c2c17d3f-23ef-4ef9-8399-c7d8f311dd04 service neutron] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_rules [ 588.825729] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22dca4e6-6372-4c46-acaf-fc503ad7f5b0 req-c2c17d3f-23ef-4ef9-8399-c7d8f311dd04 service neutron] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 588.825874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22dca4e6-6372-4c46-acaf-fc503ad7f5b0 req-c2c17d3f-23ef-4ef9-8399-c7d8f311dd04 service neutron] Enqueued Resource ID: d7594078-ff8d-4833-9397-153721382251 with Priority: HIGHEST for action port [ 588.826365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_rules [ 588.826494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 588.826588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7594078-ff8d-4833-9397-153721382251 with Priority: HIGHEST for action port [ 588.826862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.826980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.827046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.827245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.827326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.827755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.827755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.827755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.828224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.828224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.828771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.829000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.829000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.829098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.829176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.829317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.829405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.829466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.829607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.829745] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.829833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.829892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.830026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.830099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.830184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.830978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.831077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.831142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.831292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.831364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.831511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7594078-ff8d-4833-9397-153721382251 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.831599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.831655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.831796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.831867] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7594078-ff8d-4833-9397-153721382251',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.877899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-4286cb98-5c9b-49d6-98e0-bc915b5e6190 None None] Enqueued Resource ID: 97063e7d-b99c-4f76-a28a-20c83e3ce36e with Priority: HIGHEST for action port [ 588.878188] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97063e7d-b99c-4f76-a28a-20c83e3ce36e with Priority: HIGHEST for action port [ 588.878733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.878850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.878916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.879114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.879197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 588.879342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-97063e7d-b99c-4f76-a28a-20c83e3ce36e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.879793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97063e7d-b99c-4f76-a28a-20c83e3ce36e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 588.879793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97063e7d-b99c-4f76-a28a-20c83e3ce36e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 588.879793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97063e7d-b99c-4f76-a28a-20c83e3ce36e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 588.879793] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97063e7d-b99c-4f76-a28a-20c83e3ce36e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.000565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.043660] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7594078-ff8d-4833-9397-153721382251 with status ACTIVE [ 589.043871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.044009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.044083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.044298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.044387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.044565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.044658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.044717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.044905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.045021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.053472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97063e7d-b99c-4f76-a28a-20c83e3ce36e [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.053472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97063e7d-b99c-4f76-a28a-20c83e3ce36e already deleted. [ 589.053472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97063e7d-b99c-4f76-a28a-20c83e3ce36e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.058465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.088724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.088724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.088724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.088724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.088724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.088724] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be created. [ 589.092205] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.092622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.092892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.093268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.093885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.094415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-43 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.094812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-43" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.095064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-43" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.095811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-43" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.096463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.097038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.097370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.097756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.098551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.098945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-43" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.099419] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.099732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.099996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.100511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.100783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.101247] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.101576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.101805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.102582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.102953] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.112380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.112934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.113671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.114703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.115021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.133546] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.134115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.134444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.135597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.136028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.136374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c not found, creating... [ 589.136990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.137353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.137659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.138088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.138356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.138824] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.139169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.139485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.140354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.140848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.141432] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c is going to be created. [ 589.144139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: UNINITIALIZED for 2s [ 589.170992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.171743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.172090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.172521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.172890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.173597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.232399] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-60959fb4-634d-445a-ada1-8c606d3e8a72 None None] Enqueued Resource ID: cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a with Priority: HIGHEST for action port [ 589.233406] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a with Priority: HIGHEST for action port [ 589.233866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.235519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.235785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.236166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.236400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.236678] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.236915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.237065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.237385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.237602] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.267830] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a [ 589.268379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.269161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.269361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.269758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.270022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.270228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a already deleted. [ 589.270427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdbe70a5-2a7a-4ee6-aebc-59fb3a30770a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.562382] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.562768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.562768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.562934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.563049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.563188] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7594078-ff8d-4833-9397-153721382251 is going to be updated. [ 589.591923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.592098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.592169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.592485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.592769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.592769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7594078-ff8d-4833-9397-153721382251" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.559249] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-33629a83-38c1-4d58-bce5-54cfb7624c1d None None] Enqueued Resource ID: b0470b57-7274-4b27-8275-a282acf075c1 with Priority: HIGHEST for action port [ 590.559868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0470b57-7274-4b27-8275-a282acf075c1 with Priority: HIGHEST for action port [ 590.560273] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.560402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.560494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.560728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.560826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.561007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0470b57-7274-4b27-8275-a282acf075c1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.561120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0470b57-7274-4b27-8275-a282acf075c1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.561205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0470b57-7274-4b27-8275-a282acf075c1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.561454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0470b57-7274-4b27-8275-a282acf075c1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.561548] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0470b57-7274-4b27-8275-a282acf075c1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.603095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0470b57-7274-4b27-8275-a282acf075c1 [ 590.603330] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.603388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.603424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.603624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.603736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.603795] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0470b57-7274-4b27-8275-a282acf075c1 already deleted. [ 590.603886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0470b57-7274-4b27-8275-a282acf075c1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.842047] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-9e2885f0-382c-444d-9c71-ff0848070f95 req-e1d5c14c-13f8-46e7-bfb7-b82230544834 service neutron] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_rules [ 590.842297] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-9e2885f0-382c-444d-9c71-ff0848070f95 req-e1d5c14c-13f8-46e7-bfb7-b82230544834 service neutron] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 590.842576] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-9e2885f0-382c-444d-9c71-ff0848070f95 req-e1d5c14c-13f8-46e7-bfb7-b82230544834 service neutron] Enqueued Resource ID: b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c with Priority: HIGHEST for action port [ 590.843294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_rules [ 590.843428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 590.843558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c with Priority: HIGHEST for action port [ 590.843983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.844321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.844405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.844660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.844767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.844978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.845104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.845185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.845474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.845579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.846791] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.846859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.846895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.847100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.847244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.847387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.847837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.847837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.857343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.858047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.858047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.858047] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.899550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.910387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.910387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.910547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.910866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.910866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.910866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.911044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.927453] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.937204] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c with status ACTIVE [ 590.937528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.937672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.937713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.937891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.937977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.938161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.938256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.938314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.938559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.938690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.944707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.944852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.944898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.945065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.945150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 590.945237] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be created. [ 590.991519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.991661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 590.991742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 590.992074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 590.992247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.002010] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: UNINITIALIZED for 2s [ 591.160026] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: SUCCESS [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.160026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.183593] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.183746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.183822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.184121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.184185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.184341] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.184456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.184522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.187212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.187998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.214727] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8041be8d-e946-4047-8d48-0e5c8a8422c0: rpc.has_security_group_logging(os_id): False [ 591.236775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.236916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.236986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.237208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.237302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.237525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.237646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.237696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.237849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.237924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.238130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.238224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.238284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.238424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.238499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.238725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.238824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.238879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.239248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.239248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.239248] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be created. [ 591.296713] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.297076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.297076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.297188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.297188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.297295] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c is going to be updated. [ 591.304091] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b7a4bba2-c4c9-4c59-8b14-7a4545f62d99 None None] Enqueued Resource ID: b97b3722-d652-4782-a06f-c103a8ed6f16 with Priority: HIGHEST for action port [ 591.304343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97b3722-d652-4782-a06f-c103a8ed6f16 with Priority: HIGHEST for action port [ 591.305097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.305248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.305296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.305485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.305612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.305736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b97b3722-d652-4782-a06f-c103a8ed6f16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.305830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b97b3722-d652-4782-a06f-c103a8ed6f16" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.305911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b97b3722-d652-4782-a06f-c103a8ed6f16" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.306113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b97b3722-d652-4782-a06f-c103a8ed6f16" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.306218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b97b3722-d652-4782-a06f-c103a8ed6f16',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.313389] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.313534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.313603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.313804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.313993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.322304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4e36b4f-2fac-4d47-ae9c-0cdbbd7e138c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.329810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: IN_PROGRESS for 2s [ 591.329810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b97b3722-d652-4782-a06f-c103a8ed6f16 [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.329810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b97b3722-d652-4782-a06f-c103a8ed6f16 already deleted. [ 591.329810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b97b3722-d652-4782-a06f-c103a8ed6f16" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.461923] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0329945a-6be1-463a-80db-9218c311b774 None None] Enqueued Resource ID: 1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd with Priority: HIGHEST for action port [ 591.462344] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd with Priority: HIGHEST for action port [ 591.462684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.462808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.462865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.463067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.463148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.463309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.463400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.463462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.463670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.463740] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.490408] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.490408] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd already deleted. [ 591.490408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c3c1bb6-1b2c-4f8c-9f92-bfef570b7abd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.262351] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-f88a953a-42be-4918-a765-adf0085308ce req-48241d9e-42fb-4cc1-b74d-2e9e2a558fab tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 74c08519-47a4-4e81-9409-1f9ef8c2d49b with Priority: HIGHEST for action security_group_rules [ 592.262795] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c08519-47a4-4e81-9409-1f9ef8c2d49b with Priority: HIGHEST for action security_group_rules [ 592.263128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.263251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.263318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.263524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.263602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.263764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c08519-47a4-4e81-9409-1f9ef8c2d49b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.263858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c08519-47a4-4e81-9409-1f9ef8c2d49b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.263918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c08519-47a4-4e81-9409-1f9ef8c2d49b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.264320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c08519-47a4-4e81-9409-1f9ef8c2d49b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.264320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c08519-47a4-4e81-9409-1f9ef8c2d49b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.298145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.298300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.298393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.298548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.298637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.298727] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c08519-47a4-4e81-9409-1f9ef8c2d49b already deleted. [ 592.298801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c08519-47a4-4e81-9409-1f9ef8c2d49b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.012673] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: SUCCESS [ 593.012801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.012875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.013090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.013278] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.013390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.013451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.013605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.013686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.013766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.013850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.032542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.032743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.032743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.033018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.033018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.033289] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.033289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.033428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.033472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.033599] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.033689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.033750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.033884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.033963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.034043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.034189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.034278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.034336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.034470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.034541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.034711] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.034770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.034970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.034970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.035064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.035154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.035211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.035354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.035417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.035578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.035578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.081971] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5054886e-af25-43c4-9482-725da5a36a84: rpc.has_security_group_logging(os_id): False [ 593.102463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.102604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.102701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.102874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.102957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.103160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.103252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.103313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.103632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.103632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.103741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.103796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.103857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.106054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.106054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be created. [ 593.167589] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.167824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.167824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.168026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.168419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.181721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: IN_PROGRESS for 2s [ 593.339890] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: SUCCESS [ 593.340200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.776287] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a43db781-b051-429a-93aa-559891233f08 None None] Enqueued Resource ID: 6ea8dea3-6558-4f04-baa8-b7d2ea847128 with Priority: HIGHEST for action port [ 593.776504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea8dea3-6558-4f04-baa8-b7d2ea847128 with Priority: HIGHEST for action port [ 593.776790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.776976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.776976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.777189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.777269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.777421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea8dea3-6558-4f04-baa8-b7d2ea847128 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.777549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea8dea3-6558-4f04-baa8-b7d2ea847128" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.777641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea8dea3-6558-4f04-baa8-b7d2ea847128" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.777837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea8dea3-6558-4f04-baa8-b7d2ea847128" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.777917] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea8dea3-6558-4f04-baa8-b7d2ea847128',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.834082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ea8dea3-6558-4f04-baa8-b7d2ea847128 [ 593.834298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.834433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.834537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.834708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.834801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.834895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ea8dea3-6558-4f04-baa8-b7d2ea847128 already deleted. [ 593.834981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea8dea3-6558-4f04-baa8-b7d2ea847128" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.081044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e4cd4cea-f39f-48ba-8f7b-3b07691ca8a2 None None] Enqueued Resource ID: 080f55cb-0c9b-4470-ad18-d10da80fbd71 with Priority: HIGHEST for action port [ 594.081288] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 080f55cb-0c9b-4470-ad18-d10da80fbd71 with Priority: HIGHEST for action port [ 594.081855] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.081980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.082049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.082252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.082329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.082476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-080f55cb-0c9b-4470-ad18-d10da80fbd71 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.082575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-080f55cb-0c9b-4470-ad18-d10da80fbd71" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.082643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-080f55cb-0c9b-4470-ad18-d10da80fbd71" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.082839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-080f55cb-0c9b-4470-ad18-d10da80fbd71" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.082919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('080f55cb-0c9b-4470-ad18-d10da80fbd71',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.104007] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 080f55cb-0c9b-4470-ad18-d10da80fbd71 [ 594.104268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.104415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.104485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.104704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.104845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.104884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:080f55cb-0c9b-4470-ad18-d10da80fbd71 already deleted. [ 594.108099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-080f55cb-0c9b-4470-ad18-d10da80fbd71" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.817719] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b1fec400-18d0-464d-99de-709ad8e3342a tempest-ServersWithSpecificFlavorTestJSON-1283351527 tempest-ServersWithSpecificFlavorTestJSON-1283351527-project-member] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 594.818352] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 594.818836] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.819072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.819072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.819264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.819346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.819517] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.819611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.819674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.819880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.819957] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.867646] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.867811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.867861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.868132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.868225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.868324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 already deleted. [ 594.868403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.951199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-371f5f7a-991c-4dd8-9e39-ccd0441add50 req-4575f915-2c4d-4bda-9612-27cbbeefe5b6 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: d817b45c-2b5a-440e-8afa-5a5f72e0fee1 with Priority: HIGHEST for action security_group_rules [ 594.951742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d817b45c-2b5a-440e-8afa-5a5f72e0fee1 with Priority: HIGHEST for action security_group_rules [ 594.952072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.952189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.952257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.952480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.952569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.952746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d817b45c-2b5a-440e-8afa-5a5f72e0fee1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.952844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d817b45c-2b5a-440e-8afa-5a5f72e0fee1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.952900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d817b45c-2b5a-440e-8afa-5a5f72e0fee1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.953098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d817b45c-2b5a-440e-8afa-5a5f72e0fee1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.953175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d817b45c-2b5a-440e-8afa-5a5f72e0fee1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.963119] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bde766d3-126a-469c-9003-f7094d1c16ab tempest-ServersWithSpecificFlavorTestJSON-1283351527 tempest-ServersWithSpecificFlavorTestJSON-1283351527-project-member] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 594.963782] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 594.964227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.964560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.964678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.964928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.965112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.965333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.965521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.965638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.965876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.965973] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.010480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.010617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.010695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.010929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.011024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.011122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d817b45c-2b5a-440e-8afa-5a5f72e0fee1 already deleted. [ 595.011205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d817b45c-2b5a-440e-8afa-5a5f72e0fee1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.020522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.020700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.020742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.020952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.021053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.021145] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 already deleted. [ 595.021227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.200335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: SUCCESS [ 595.200335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 596.999943] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e492febc-cbb0-4b30-9ae8-f6c4ee5e7753 tempest-VolumesAssistedSnapshotsTest-322351418 tempest-VolumesAssistedSnapshotsTest-322351418-project-member] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 597.000497] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 597.000837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.000961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.001029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.001232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.001317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.001466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.001561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.001621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.001818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.001897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.094250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.094441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.094503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.094660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.094750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.094871] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1158288-998a-4271-bc1a-cf68dc491870 already deleted. [ 597.094993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.216774] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d85f2015-f762-47ea-b758-c14e8b832e55 None None] Enqueued Resource ID: b4cfb740-662a-4131-b5c4-e5761c43632f with Priority: HIGHEST for action port [ 597.217299] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4cfb740-662a-4131-b5c4-e5761c43632f with Priority: HIGHEST for action port [ 597.217631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.217790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.217825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.218000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.218077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.218223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4cfb740-662a-4131-b5c4-e5761c43632f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.218313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4cfb740-662a-4131-b5c4-e5761c43632f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.218371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4cfb740-662a-4131-b5c4-e5761c43632f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.218558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4cfb740-662a-4131-b5c4-e5761c43632f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.218633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4cfb740-662a-4131-b5c4-e5761c43632f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.247039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4cfb740-662a-4131-b5c4-e5761c43632f [ 597.247256] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.247382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.247449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.247689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.247775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.247868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4cfb740-662a-4131-b5c4-e5761c43632f already deleted. [ 597.247943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4cfb740-662a-4131-b5c4-e5761c43632f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.274288] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-70cc797d-0c6f-4200-918d-b35ceb8ea0ef tempest-VolumesAssistedSnapshotsTest-322351418 tempest-VolumesAssistedSnapshotsTest-322351418-project-member] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 597.274797] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 597.275096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.275211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.275275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.275491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.275570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.275730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.275824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.275881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.276036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.276109] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.316206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.316361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.316441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.316655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.316771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.316867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1158288-998a-4271-bc1a-cf68dc491870 already deleted. [ 597.316946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.399841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8517799e-4c34-4acc-b64c-67b0c3e70362 None None] Enqueued Resource ID: 968ee985-69dc-4644-9eaa-c2a80b24faef with Priority: HIGHEST for action port [ 597.400114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968ee985-69dc-4644-9eaa-c2a80b24faef with Priority: HIGHEST for action port [ 597.401071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.401177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.401245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.401437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.401553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.401668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-968ee985-69dc-4644-9eaa-c2a80b24faef taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.401760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968ee985-69dc-4644-9eaa-c2a80b24faef" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.401821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968ee985-69dc-4644-9eaa-c2a80b24faef" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.402007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968ee985-69dc-4644-9eaa-c2a80b24faef" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.402080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968ee985-69dc-4644-9eaa-c2a80b24faef',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.428234] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 968ee985-69dc-4644-9eaa-c2a80b24faef [ 597.428436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.428723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.428723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.428883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.428970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.429060] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:968ee985-69dc-4644-9eaa-c2a80b24faef already deleted. [ 597.429143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968ee985-69dc-4644-9eaa-c2a80b24faef" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.356178] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-1184c9e3-799d-41c0-9319-9afbe8e60a8f req-ddb0634d-1565-48e4-b095-d5d1d5563db3 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 04c07c51-8073-4fce-9916-1bc23071ba87 with Priority: HIGHEST for action security_group_rules [ 600.356735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c07c51-8073-4fce-9916-1bc23071ba87 with Priority: HIGHEST for action security_group_rules [ 600.357060] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.357191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.357259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.357454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.357561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.357724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04c07c51-8073-4fce-9916-1bc23071ba87 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.357821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04c07c51-8073-4fce-9916-1bc23071ba87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.357891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04c07c51-8073-4fce-9916-1bc23071ba87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.362579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04c07c51-8073-4fce-9916-1bc23071ba87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.362579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04c07c51-8073-4fce-9916-1bc23071ba87',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.407078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.407228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.407280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.407516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.407660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.407709] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04c07c51-8073-4fce-9916-1bc23071ba87 already deleted. [ 600.407790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04c07c51-8073-4fce-9916-1bc23071ba87" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.522254] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c3c3dd67-0553-4789-8301-e0155c0ad1cd None None] Enqueued Resource ID: 1753e519-3a9f-47d4-8bd7-3b6c20c09b7d with Priority: HIGHEST for action port [ 600.522254] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1753e519-3a9f-47d4-8bd7-3b6c20c09b7d with Priority: HIGHEST for action port [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1753e519-3a9f-47d4-8bd7-3b6c20c09b7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1753e519-3a9f-47d4-8bd7-3b6c20c09b7d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1753e519-3a9f-47d4-8bd7-3b6c20c09b7d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1753e519-3a9f-47d4-8bd7-3b6c20c09b7d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.522254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1753e519-3a9f-47d4-8bd7-3b6c20c09b7d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.554982] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1753e519-3a9f-47d4-8bd7-3b6c20c09b7d [ 600.554982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.555107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.555107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.555274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.555367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.555471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1753e519-3a9f-47d4-8bd7-3b6c20c09b7d already deleted. [ 600.555536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1753e519-3a9f-47d4-8bd7-3b6c20c09b7d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.664268] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2457c350-7a05-4a7c-a640-2e5434610216 None None] Enqueued Resource ID: 01972dec-6529-42ad-a3dd-a45b24de4c3f with Priority: HIGHEST for action port [ 600.664268] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01972dec-6529-42ad-a3dd-a45b24de4c3f with Priority: HIGHEST for action port [ 600.665052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.665052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.665269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.665382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.665491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.665686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-01972dec-6529-42ad-a3dd-a45b24de4c3f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.665816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01972dec-6529-42ad-a3dd-a45b24de4c3f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.665891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01972dec-6529-42ad-a3dd-a45b24de4c3f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.666114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01972dec-6529-42ad-a3dd-a45b24de4c3f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.666196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01972dec-6529-42ad-a3dd-a45b24de4c3f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.681711] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01972dec-6529-42ad-a3dd-a45b24de4c3f [ 600.681831] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.682012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.682089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.682309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.682414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.682498] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01972dec-6529-42ad-a3dd-a45b24de4c3f already deleted. [ 600.682594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01972dec-6529-42ad-a3dd-a45b24de4c3f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.983240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2c0cf2b9-40cc-42aa-ae47-4ef3af37dc1b None None] Enqueued Resource ID: 2d17c1df-5ef8-4e98-a9a9-f17be1d489fb with Priority: HIGHEST for action port [ 601.983511] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d17c1df-5ef8-4e98-a9a9-f17be1d489fb with Priority: HIGHEST for action port [ 601.984103] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.984294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.984489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.984568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.984718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d17c1df-5ef8-4e98-a9a9-f17be1d489fb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d17c1df-5ef8-4e98-a9a9-f17be1d489fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.984874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d17c1df-5ef8-4e98-a9a9-f17be1d489fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.985144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d17c1df-5ef8-4e98-a9a9-f17be1d489fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.985144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d17c1df-5ef8-4e98-a9a9-f17be1d489fb',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.028693] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d17c1df-5ef8-4e98-a9a9-f17be1d489fb [ 602.028943] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.029081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.029162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.029362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.029440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.029543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d17c1df-5ef8-4e98-a9a9-f17be1d489fb already deleted. [ 602.029617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d17c1df-5ef8-4e98-a9a9-f17be1d489fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.558762] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-efc7d3e9-8fa8-44f9-bebc-3b8d58e32b87 req-f78fe04b-f514-469f-99e9-e2684fcaea3a tempest-ServersWithSpecificFlavorTestJSON-1283351527 tempest-ServersWithSpecificFlavorTestJSON-1283351527-project-member] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 602.559385] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.560485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.560712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.560712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.560781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.560922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.561013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.561073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.561216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.561297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.561396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.580668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.580822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.580986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.581106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.581203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.581407] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.581519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.581565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.581717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.581792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.581879] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 already deleted. [ 602.581954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-418 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-418" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-418" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.088353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-418" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.088925] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.088925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.088925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.088925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.089321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.089321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-418" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.089532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.089700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.089823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.090033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.090170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.090413] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-9b70a2b2-4247-4555-8bdb-11c1fe338eac taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.090571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.090691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.090959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.091101] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b70a2b2-4247-4555-8bdb-11c1fe338eac',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.112636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.112846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.112972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.113259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.113398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.113564] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 9b70a2b2-4247-4555-8bdb-11c1fe338eac not found, creating... [ 603.113842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.114000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.114115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.114329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.115472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.115472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 9b70a2b2-4247-4555-8bdb-11c1fe338eac is going to be created. [ 603.138299] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.138556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.138646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.138948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.139191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.139419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.247831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bc3d57d4-57b0-4108-8ba7-484011552f2d None None] Enqueued Resource ID: b8922b67-7a60-4303-abb7-9eff09747461 with Priority: HIGHEST for action port [ 603.248988] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8922b67-7a60-4303-abb7-9eff09747461 with Priority: HIGHEST for action port [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8922b67-7a60-4303-abb7-9eff09747461 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8922b67-7a60-4303-abb7-9eff09747461" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8922b67-7a60-4303-abb7-9eff09747461" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8922b67-7a60-4303-abb7-9eff09747461" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.251358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8922b67-7a60-4303-abb7-9eff09747461',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.266981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8922b67-7a60-4303-abb7-9eff09747461 [ 603.267187] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.267338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.267388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.267617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.267703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.267801] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8922b67-7a60-4303-abb7-9eff09747461 already deleted. [ 603.267880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8922b67-7a60-4303-abb7-9eff09747461" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.931161] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-efc7d3e9-8fa8-44f9-bebc-3b8d58e32b87 req-8d5cefc0-3ff6-4b5d-8cef-1536712ed0a4 service neutron] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 603.931339] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-efc7d3e9-8fa8-44f9-bebc-3b8d58e32b87 req-8d5cefc0-3ff6-4b5d-8cef-1536712ed0a4 service neutron] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 603.931502] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-efc7d3e9-8fa8-44f9-bebc-3b8d58e32b87 req-8d5cefc0-3ff6-4b5d-8cef-1536712ed0a4 service neutron] Enqueued Resource ID: 9b70a2b2-4247-4555-8bdb-11c1fe338eac with Priority: HIGHEST for action port [ 603.932618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_rules [ 603.932618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 603.932618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b70a2b2-4247-4555-8bdb-11c1fe338eac with Priority: HIGHEST for action port [ 603.932618] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.932618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.932897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.932936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.933002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.933155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.933249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.933308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.933452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.933526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.934333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.934434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.934514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.934681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.934745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.934885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.934976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.935038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.935183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.935316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.935430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.935509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.935658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.935745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.935817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.936604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.936681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.936745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.936893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.936963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.937098] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b70a2b2-4247-4555-8bdb-11c1fe338eac taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.937185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.937239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.937370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.937483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b70a2b2-4247-4555-8bdb-11c1fe338eac',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.014218] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b70a2b2-4247-4555-8bdb-11c1fe338eac with status ACTIVE [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.014218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.014937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.014937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.014937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.014937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.037594] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.049741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.049934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.049983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.050182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.050265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.050368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 is going to be created. [ 604.077620] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.077846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.077846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.078053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.078218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.088248] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: UNINITIALIZED for 2s [ 604.362530] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-03e37004-c144-48e9-b397-62ce395ef2c9 tempest-TaggedAttachmentsTest-1196056706 tempest-TaggedAttachmentsTest-1196056706-project-member] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 604.363200] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 604.363541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.363668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.363734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.363932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.364028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.364181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.364277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.364335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.364514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.364592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.407436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.407579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.407579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.407774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.407870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.407969] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 already deleted. [ 604.408095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.440603] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.440747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.440896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.441035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.441121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.441215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b70a2b2-4247-4555-8bdb-11c1fe338eac is going to be updated. [ 604.462069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.462216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.462285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.462494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.462716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.462814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b70a2b2-4247-4555-8bdb-11c1fe338eac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.581015] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0614ffd9-d9fa-4b20-a0a1-1b153b196daa tempest-TaggedAttachmentsTest-1196056706 tempest-TaggedAttachmentsTest-1196056706-project-member] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 604.581579] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 604.581923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.582055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.582129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.582340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.582340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.582516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.582617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.582683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.582867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.582951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.648396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.648493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.648545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.648765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.648858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.648952] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 already deleted. [ 604.649030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.144051] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-28e7afc0-89ff-4e9b-b8d4-5650ba3c3f07 tempest-ServerActionsTestJSON-25147579 tempest-ServerActionsTestJSON-25147579-project-member] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 605.144592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 605.144913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.145038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.145107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.145307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.145393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.145548] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.145648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.145708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.145904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.145985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.196680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.196897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.196982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.197206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.197304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.197400] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 already deleted. [ 605.197539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.792139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5b22d23c-a581-472a-abf6-a428b860ff9f tempest-ServerActionsTestJSON-25147579 tempest-ServerActionsTestJSON-25147579-project-member] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 605.792634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 605.792944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.793084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.793131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.793326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.793401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.793589] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.793661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.793704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.793842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.793915] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.876808] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.877008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 605.877121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 605.877402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 605.877566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 605.877709] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 already deleted. [ 605.878007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.055181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-13c37956-b63b-462b-b83b-5f41ed7cf485 None None] Enqueued Resource ID: a00b2702-fe28-4f12-9ee9-59bcc8919ce4 with Priority: HIGHEST for action port [ 606.055181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a00b2702-fe28-4f12-9ee9-59bcc8919ce4 with Priority: HIGHEST for action port [ 606.055307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.055377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.055455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.055641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.055721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.056194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a00b2702-fe28-4f12-9ee9-59bcc8919ce4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.056194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a00b2702-fe28-4f12-9ee9-59bcc8919ce4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.056194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a00b2702-fe28-4f12-9ee9-59bcc8919ce4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.056474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a00b2702-fe28-4f12-9ee9-59bcc8919ce4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.056474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a00b2702-fe28-4f12-9ee9-59bcc8919ce4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.097865] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: SUCCESS [ 606.098077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.098244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.098452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.098700] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.098826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.098898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.099385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.099385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.099385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.099385] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.116590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a00b2702-fe28-4f12-9ee9-59bcc8919ce4 [ 606.116768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.116907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.116976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.117181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.117261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.117351] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a00b2702-fe28-4f12-9ee9-59bcc8919ce4 already deleted. [ 606.117427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a00b2702-fe28-4f12-9ee9-59bcc8919ce4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.121255] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.156488] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469: rpc.has_security_group_logging(os_id): False [ 606.175303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.175570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.175663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.175874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.175980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.176379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.176487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.176567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.176727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.177246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.177394] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 is going to be created. [ 606.238191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.238360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.238360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.238581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.238768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.251566] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: IN_PROGRESS for 2s [ 607.177099] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca773c5d-886c-4670-8130-8ffca68533c1 req-0e67483d-bfd2-4afb-8b7a-122d30dda184 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 0ec20027-d349-4ce3-ad1b-b28e97b3c0c7 with Priority: HIGHEST for action security_group_rules [ 607.177649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ec20027-d349-4ce3-ad1b-b28e97b3c0c7 with Priority: HIGHEST for action security_group_rules [ 607.177960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.178146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.178341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.178422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.178595] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ec20027-d349-4ce3-ad1b-b28e97b3c0c7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ec20027-d349-4ce3-ad1b-b28e97b3c0c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.178766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ec20027-d349-4ce3-ad1b-b28e97b3c0c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.178982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ec20027-d349-4ce3-ad1b-b28e97b3c0c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.179052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ec20027-d349-4ce3-ad1b-b28e97b3c0c7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.214620] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.214783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.214839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.215039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.215123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.215213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ec20027-d349-4ce3-ad1b-b28e97b3c0c7 already deleted. [ 607.215291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ec20027-d349-4ce3-ad1b-b28e97b3c0c7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.235634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-ac52e43d-6bb6-4be2-adbe-83aca9a8a64e None None] Enqueued Resource ID: 3f788d3d-2eb0-4eda-90f5-c293bf0a6200 with Priority: HIGHEST for action port [ 607.235749] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f788d3d-2eb0-4eda-90f5-c293bf0a6200 with Priority: HIGHEST for action port [ 607.236460] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.236536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.236602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.236803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.236875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.237041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f788d3d-2eb0-4eda-90f5-c293bf0a6200 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.237145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f788d3d-2eb0-4eda-90f5-c293bf0a6200" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.237207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f788d3d-2eb0-4eda-90f5-c293bf0a6200" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.237560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f788d3d-2eb0-4eda-90f5-c293bf0a6200" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.237657] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f788d3d-2eb0-4eda-90f5-c293bf0a6200',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.279184] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f788d3d-2eb0-4eda-90f5-c293bf0a6200 [ 607.279462] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.279575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.279642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.279843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.279959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.280038] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f788d3d-2eb0-4eda-90f5-c293bf0a6200 already deleted. [ 607.280120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f788d3d-2eb0-4eda-90f5-c293bf0a6200" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.957714] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b7e2957f-2b6c-401e-b249-8bc2f21df231 None None] Enqueued Resource ID: 8001b9a7-6eeb-4074-bd33-7d01c97ee38e with Priority: HIGHEST for action port [ 607.958541] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8001b9a7-6eeb-4074-bd33-7d01c97ee38e with Priority: HIGHEST for action port [ 607.958541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.958704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.958744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.958953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.959061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.959224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8001b9a7-6eeb-4074-bd33-7d01c97ee38e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.959327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8001b9a7-6eeb-4074-bd33-7d01c97ee38e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.959393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8001b9a7-6eeb-4074-bd33-7d01c97ee38e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.959599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8001b9a7-6eeb-4074-bd33-7d01c97ee38e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.959694] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8001b9a7-6eeb-4074-bd33-7d01c97ee38e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.978432] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8001b9a7-6eeb-4074-bd33-7d01c97ee38e [ 607.978720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.978870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.978941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.979165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.979254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.979365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8001b9a7-6eeb-4074-bd33-7d01c97ee38e already deleted. [ 607.980043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8001b9a7-6eeb-4074-bd33-7d01c97ee38e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.142338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a25d703c-d607-4176-8d02-d06f1e740761 None None] Enqueued Resource ID: 84bc3a8f-a161-46c2-ad19-08660d21e36f with Priority: HIGHEST for action port [ 608.142595] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84bc3a8f-a161-46c2-ad19-08660d21e36f with Priority: HIGHEST for action port [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-84bc3a8f-a161-46c2-ad19-08660d21e36f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84bc3a8f-a161-46c2-ad19-08660d21e36f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84bc3a8f-a161-46c2-ad19-08660d21e36f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.144187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84bc3a8f-a161-46c2-ad19-08660d21e36f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.144688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84bc3a8f-a161-46c2-ad19-08660d21e36f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.157700] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84bc3a8f-a161-46c2-ad19-08660d21e36f [ 608.157912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.158067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.158127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.158349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.158422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.158543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84bc3a8f-a161-46c2-ad19-08660d21e36f already deleted. [ 608.158638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84bc3a8f-a161-46c2-ad19-08660d21e36f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.263453] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: SUCCESS [ 608.263698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.400466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-11a26286-2da3-4ab1-8280-0d01b7be6071 tempest-ServersTestFqdnHostnames-913108469 tempest-ServersTestFqdnHostnames-913108469-project-member] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 608.400466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.400466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.436168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.436538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.436538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.436672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.436672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.436747] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 already deleted. [ 608.436831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.591677] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a87aa6c1-c64f-490b-9ae8-b41bb2e49275 tempest-ServersTestFqdnHostnames-913108469 tempest-ServersTestFqdnHostnames-913108469-project-member] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 608.592276] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 608.592605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.592735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.592814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.593033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.593123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.593301] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.593405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.593481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.593677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.593763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.709874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.710028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.710109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.710339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.710475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.710621] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 already deleted. [ 608.710715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.179442] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1a96429a-1ad3-455f-a20c-2581ec9dc66d None None] Enqueued Resource ID: 16b97e08-6150-4c29-89f8-3cbffa68218a with Priority: HIGHEST for action port [ 609.179623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b97e08-6150-4c29-89f8-3cbffa68218a with Priority: HIGHEST for action port [ 609.180206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.180346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.180414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.180672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.180726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.180849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-16b97e08-6150-4c29-89f8-3cbffa68218a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.180938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16b97e08-6150-4c29-89f8-3cbffa68218a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.180997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16b97e08-6150-4c29-89f8-3cbffa68218a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.181220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16b97e08-6150-4c29-89f8-3cbffa68218a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.181298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16b97e08-6150-4c29-89f8-3cbffa68218a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.229042] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16b97e08-6150-4c29-89f8-3cbffa68218a [ 609.229277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.229386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.229512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.229656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.229741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.229842] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16b97e08-6150-4c29-89f8-3cbffa68218a already deleted. [ 609.231105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16b97e08-6150-4c29-89f8-3cbffa68218a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.042015] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6f258aa0-640a-4448-b19f-be23a8cda067 None None] Enqueued Resource ID: fae26160-7137-4c70-95d9-ea3916e1f3e1 with Priority: HIGHEST for action port [ 610.042015] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae26160-7137-4c70-95d9-ea3916e1f3e1 with Priority: HIGHEST for action port [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-fae26160-7137-4c70-95d9-ea3916e1f3e1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fae26160-7137-4c70-95d9-ea3916e1f3e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fae26160-7137-4c70-95d9-ea3916e1f3e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fae26160-7137-4c70-95d9-ea3916e1f3e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.042015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae26160-7137-4c70-95d9-ea3916e1f3e1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.066356] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fae26160-7137-4c70-95d9-ea3916e1f3e1 [ 610.066356] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.066356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.066356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.066629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.066666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.066790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fae26160-7137-4c70-95d9-ea3916e1f3e1 already deleted. [ 610.066896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fae26160-7137-4c70-95d9-ea3916e1f3e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.242346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-9a6dffde-82b5-455a-8036-795085022aa3 None None] Enqueued Resource ID: 453ce7ae-d5f9-4b91-b19c-dc88cc13b535 with Priority: HIGHEST for action port [ 611.242630] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453ce7ae-d5f9-4b91-b19c-dc88cc13b535 with Priority: HIGHEST for action port [ 611.243240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.243388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.243463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.243974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.244080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.244239] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-453ce7ae-d5f9-4b91-b19c-dc88cc13b535 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.244332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453ce7ae-d5f9-4b91-b19c-dc88cc13b535" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.244396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453ce7ae-d5f9-4b91-b19c-dc88cc13b535" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.244601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453ce7ae-d5f9-4b91-b19c-dc88cc13b535" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.244704] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453ce7ae-d5f9-4b91-b19c-dc88cc13b535',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.256910] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 453ce7ae-d5f9-4b91-b19c-dc88cc13b535 [ 611.256910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.256910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.257109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.257208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.257299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.257395] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:453ce7ae-d5f9-4b91-b19c-dc88cc13b535 already deleted. [ 611.257521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453ce7ae-d5f9-4b91-b19c-dc88cc13b535" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.383600] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-801a9efc-0e0b-4ba9-a25c-b0d2e08c0ad7 None None] Enqueued Resource ID: 0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787 with Priority: HIGHEST for action port [ 613.383949] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787 with Priority: HIGHEST for action port [ 613.384425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.384550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.384632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.384840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.384933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.385086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.385208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.385302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.385450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.392130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.410429] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787 [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.410429] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787 already deleted. [ 613.410429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d4d6ca3-bf0d-4dcc-8fd7-5191fe35c787" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.588335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6f497cff-49e3-47d3-b971-ccdc4c13e1e6 req-428e4e1d-ada2-4f84-97c4-129b7f636342 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 613.588910] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 613.589237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.589363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.589436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.589634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.589719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.589875] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.589968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.590035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.590234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.590313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4062caa8-805a-44fe-9fb6-663c5f7cc6f6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.642965] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.643225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.643225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.643340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.643432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.643530] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 already deleted. [ 613.643672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.229543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8be0e0f2-c549-433e-aa2e-7ea89a4bbca5 tempest-ServersTestJSON-1344348499 tempest-ServersTestJSON-1344348499-project-member] Enqueued Resource ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 with Priority: HIGHEST for action security_group_rules [ 614.230126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 with Priority: HIGHEST for action security_group_rules [ 614.230451] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.230578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.230657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.230848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.230933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.231093] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb7daa0-bbd5-4b21-8b25-673f71485081 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.231197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.231245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.231446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.231524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb7daa0-bbd5-4b21-8b25-673f71485081',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.271465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.271465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.271465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.271465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.271741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.271741] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 already deleted. [ 614.271898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.344833] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-60efc966-27ad-4d80-bd2d-3daf2c6dadaa tempest-ServersTestJSON-1344348499 tempest-ServersTestJSON-1344348499-project-member] Enqueued Resource ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 with Priority: HIGHEST for action security_group_rules [ 614.345470] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 with Priority: HIGHEST for action security_group_rules [ 614.345876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.346068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.346166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.346396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.346522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.346801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb7daa0-bbd5-4b21-8b25-673f71485081 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.346970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.347079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.347286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.347398] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb7daa0-bbd5-4b21-8b25-673f71485081',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.381929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.382111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.382180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.382427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.382553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.382693] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb7daa0-bbd5-4b21-8b25-673f71485081 already deleted. [ 614.382799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb7daa0-bbd5-4b21-8b25-673f71485081" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.625987] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-82c8145c-96b8-450d-8cb0-b014e3bd4879 req-7bfedbe0-a91d-41d2-8dc1-116f1d284df9 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 614.626489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 614.627186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.627311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.627377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.627642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.627723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.627964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.627964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.628084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.628326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.628645] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4062caa8-805a-44fe-9fb6-663c5f7cc6f6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.667285] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.667438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.667582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.667739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.667832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.667933] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 already deleted. [ 614.668028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 616.405272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2fc6b32d-2b77-4323-9853-008b7825183d req-2d163676-1265-4c33-87a5-1844c8772327 tempest-SecurityGroupRulesTestJSON-333945418 tempest-SecurityGroupRulesTestJSON-333945418-project-member] Enqueued Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 616.405781] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 with Priority: HIGHEST for action security_group_rules [ 616.406093] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.406209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 616.406272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 616.406470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 616.406559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 616.406710] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.406803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 616.406863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 616.407007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 616.407079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4062caa8-805a-44fe-9fb6-663c5f7cc6f6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.451428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.451568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 616.451639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 616.451847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 616.451938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 616.452122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4062caa8-805a-44fe-9fb6-663c5f7cc6f6 already deleted. [ 616.452122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4062caa8-805a-44fe-9fb6-663c5f7cc6f6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.360707] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-935abcbe-87ec-40d6-a6eb-55bfc1cb6f3c req-9cb3e844-a9e8-400b-aacd-846b6fb80af5 tempest-VolumesAssistedSnapshotsTest-322351418 tempest-VolumesAssistedSnapshotsTest-322351418-project-member] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 618.361261] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 618.361580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.361709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.361779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.361984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.362055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.362209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.362304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.362367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.362558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.362751] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.362822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.362879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.362995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.363075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.363164] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.372346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.372496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.372550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.372718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.372810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.372990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.373428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.373428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.373428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.373428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.373428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1158288-998a-4271-bc1a-cf68dc491870 already deleted. [ 618.373659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.764561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.764785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.764917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.765195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.765340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.765648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-725 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.765816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-725" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.765954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-725" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.766229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-725" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.766484] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.766646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.766766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.766978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.767121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.767273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-725" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.767562] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.767731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.767851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.768094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.768245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.768874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-3546727b-2dca-4825-9fda-6a541081d212 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.769241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.769374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.769720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.769866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3546727b-2dca-4825-9fda-6a541081d212',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.784689] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.784905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.785023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.785267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.785438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.785606] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 3546727b-2dca-4825-9fda-6a541081d212 not found, creating... [ 618.785868] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.786064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.786139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.786361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.786503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.786786] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.786941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.787060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.787269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.787416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.787577] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 3546727b-2dca-4825-9fda-6a541081d212 is going to be created. [ 618.810385] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.810608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 618.810739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 618.811024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 618.811433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 618.811552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-935abcbe-87ec-40d6-a6eb-55bfc1cb6f3c req-7f2394e3-5a64-46ff-a159-32208fb52fc1 service neutron] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-935abcbe-87ec-40d6-a6eb-55bfc1cb6f3c req-7f2394e3-5a64-46ff-a159-32208fb52fc1 service neutron] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-935abcbe-87ec-40d6-a6eb-55bfc1cb6f3c req-7f2394e3-5a64-46ff-a159-32208fb52fc1 service neutron] Enqueued Resource ID: 3546727b-2dca-4825-9fda-6a541081d212 with Priority: HIGHEST for action port [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_rules [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 619.136525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546727b-2dca-4825-9fda-6a541081d212 with Priority: HIGHEST for action port [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.136525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.137332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.137934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.138968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.139307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.139681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.139869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.144277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.145006] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.145006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.145006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-3546727b-2dca-4825-9fda-6a541081d212 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.148021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3546727b-2dca-4825-9fda-6a541081d212',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.178051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.179983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.181154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.183100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.183441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.183775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.184211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.184470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.189331] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.190745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3546727b-2dca-4825-9fda-6a541081d212 with status ACTIVE [ 619.191144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.191495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.191701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.192046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.192276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.192792] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.193168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.193372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.193659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.193870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.198756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.199092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.199296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.199623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.199981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.200308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1158288-998a-4271-bc1a-cf68dc491870 is going to be created. [ 619.270524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.270524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.270524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.270524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.270524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.278976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: UNINITIALIZED for 2s [ 619.576228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.576228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.576228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.576553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.576553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.576616] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3546727b-2dca-4825-9fda-6a541081d212 is going to be updated. [ 619.600720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.600972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.600972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.601167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.601313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.601487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3546727b-2dca-4825-9fda-6a541081d212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.290128] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: SUCCESS [ 621.290367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.290541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.290722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.290927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.291047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.291114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.291268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.291354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.291441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.291528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.344577] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.365851] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1158288-998a-4271-bc1a-cf68dc491870: rpc.has_security_group_logging(os_id): False [ 621.386237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.386398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.386472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.386715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.386983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.387168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.387168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.387316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.387387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.387455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.387581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1158288-998a-4271-bc1a-cf68dc491870 is going to be created. [ 621.465437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.465616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.465747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.465903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.466106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.480263] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: IN_PROGRESS for 2s [ 621.907225] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-aa271591-5006-4283-8001-428f1593a1dc None None] Enqueued Resource ID: a45fad83-8219-4797-851d-673e09303132 with Priority: HIGHEST for action port [ 621.908536] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a45fad83-8219-4797-851d-673e09303132 with Priority: HIGHEST for action port [ 621.908536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.908536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.908536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.908732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.908815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.908977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a45fad83-8219-4797-851d-673e09303132 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.909079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a45fad83-8219-4797-851d-673e09303132" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.909142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a45fad83-8219-4797-851d-673e09303132" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.909355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a45fad83-8219-4797-851d-673e09303132" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.909433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45fad83-8219-4797-851d-673e09303132',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.136704] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a45fad83-8219-4797-851d-673e09303132 [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.136704] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a45fad83-8219-4797-851d-673e09303132 already deleted. [ 622.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a45fad83-8219-4797-851d-673e09303132" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.493572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: SUCCESS [ 623.493851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.955035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d060760c-7e80-45f4-9ea7-6c777a4b1326 None None] Enqueued Resource ID: 185fcb73-b88d-4abb-8292-e9b69620db3e with Priority: HIGHEST for action port [ 624.955313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185fcb73-b88d-4abb-8292-e9b69620db3e with Priority: HIGHEST for action port [ 624.955777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.955899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.955966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-185fcb73-b88d-4abb-8292-e9b69620db3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-185fcb73-b88d-4abb-8292-e9b69620db3e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-185fcb73-b88d-4abb-8292-e9b69620db3e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-185fcb73-b88d-4abb-8292-e9b69620db3e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.956926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('185fcb73-b88d-4abb-8292-e9b69620db3e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.972450] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 185fcb73-b88d-4abb-8292-e9b69620db3e [ 624.972667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.972777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.972844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.973040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.973125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.973279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:185fcb73-b88d-4abb-8292-e9b69620db3e already deleted. [ 624.973327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-185fcb73-b88d-4abb-8292-e9b69620db3e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 627.852043] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-486c43ff-db0f-4b7c-a881-0e1e22571a53 None None] Enqueued Resource ID: 5087c7f6-e817-46da-a477-e3a0fbb76ced with Priority: HIGHEST for action port [ 627.852315] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5087c7f6-e817-46da-a477-e3a0fbb76ced with Priority: HIGHEST for action port [ 627.852905] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.853030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 627.853098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 627.853306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 627.853404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 627.853609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5087c7f6-e817-46da-a477-e3a0fbb76ced taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.853694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5087c7f6-e817-46da-a477-e3a0fbb76ced" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 627.853731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5087c7f6-e817-46da-a477-e3a0fbb76ced" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 627.854668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5087c7f6-e817-46da-a477-e3a0fbb76ced" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 627.854668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5087c7f6-e817-46da-a477-e3a0fbb76ced',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.874292] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5087c7f6-e817-46da-a477-e3a0fbb76ced [ 627.874529] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.874529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 627.874671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 627.874802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 627.874889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 627.874980] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5087c7f6-e817-46da-a477-e3a0fbb76ced already deleted. [ 627.875057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5087c7f6-e817-46da-a477-e3a0fbb76ced" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.264975] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-be9489e2-d9ab-4115-a183-28e8b4751f4d None None] Enqueued Resource ID: 07d0d23c-f998-48d6-aae8-0cbc546c8e9a with Priority: HIGHEST for action port [ 628.265233] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d0d23c-f998-48d6-aae8-0cbc546c8e9a with Priority: HIGHEST for action port [ 628.265858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.265986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.266056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-07d0d23c-f998-48d6-aae8-0cbc546c8e9a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07d0d23c-f998-48d6-aae8-0cbc546c8e9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07d0d23c-f998-48d6-aae8-0cbc546c8e9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07d0d23c-f998-48d6-aae8-0cbc546c8e9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.270637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07d0d23c-f998-48d6-aae8-0cbc546c8e9a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.284472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07d0d23c-f998-48d6-aae8-0cbc546c8e9a [ 628.284674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.284867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.284867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.285057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.285186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.285233] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07d0d23c-f998-48d6-aae8-0cbc546c8e9a already deleted. [ 628.285310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07d0d23c-f998-48d6-aae8-0cbc546c8e9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.406095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-383c1dcf-ab7c-4ef4-bae7-15a05860e1f1 None None] Enqueued Resource ID: 45554df0-cd02-4a15-8331-44e78ea3e001 with Priority: HIGHEST for action port [ 630.406364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45554df0-cd02-4a15-8331-44e78ea3e001 with Priority: HIGHEST for action port [ 630.406960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.407094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.407163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.407364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.407450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.407675] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-45554df0-cd02-4a15-8331-44e78ea3e001 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.407778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45554df0-cd02-4a15-8331-44e78ea3e001" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.407842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45554df0-cd02-4a15-8331-44e78ea3e001" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.408073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45554df0-cd02-4a15-8331-44e78ea3e001" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.408581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45554df0-cd02-4a15-8331-44e78ea3e001',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.444402] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45554df0-cd02-4a15-8331-44e78ea3e001 [ 630.444540] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.444723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.444760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.445282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.445412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.445516] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45554df0-cd02-4a15-8331-44e78ea3e001 already deleted. [ 630.445603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45554df0-cd02-4a15-8331-44e78ea3e001" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.692599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b36c36b7-f9ab-4260-ba9a-0ad968cce68e None None] Enqueued Resource ID: f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387 with Priority: HIGHEST for action port [ 630.692844] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387 with Priority: HIGHEST for action port [ 630.693421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.693606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.693663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.693830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.693918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.694067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.694157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.694401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.694478] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.732274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387 [ 630.732488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.732615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.732681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.732891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.732983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.733078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387 already deleted. [ 630.733160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9bcc6e6-4f6f-4ccc-9bcb-ed3f50ac3387" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.919998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-fd1f549c-6e82-4c9c-a357-8a9acb14149a tempest-ServerActionsTestOtherA-1944985306 tempest-ServerActionsTestOtherA-1944985306-project-member] Enqueued Resource ID: b3585b8f-4551-42e2-b768-877c0ce343e2 with Priority: HIGHEST for action security_group_rules [ 630.920521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3585b8f-4551-42e2-b768-877c0ce343e2 with Priority: HIGHEST for action security_group_rules [ 630.920835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.920954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.921018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.921213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.921297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 630.921450] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3585b8f-4551-42e2-b768-877c0ce343e2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.921553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 630.921612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 630.921802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 630.921874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3585b8f-4551-42e2-b768-877c0ce343e2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.015310] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3585b8f-4551-42e2-b768-877c0ce343e2 already deleted. [ 631.015310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.298711] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e37564fe-01dd-4091-aff2-729865d54ff8 None None] Enqueued Resource ID: a94f07d4-3f7f-43d2-b8ef-9f44db314698 with Priority: HIGHEST for action port [ 631.298907] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a94f07d4-3f7f-43d2-b8ef-9f44db314698 with Priority: HIGHEST for action port [ 631.299504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.299635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.299703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a94f07d4-3f7f-43d2-b8ef-9f44db314698 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a94f07d4-3f7f-43d2-b8ef-9f44db314698" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a94f07d4-3f7f-43d2-b8ef-9f44db314698" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a94f07d4-3f7f-43d2-b8ef-9f44db314698" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.301396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a94f07d4-3f7f-43d2-b8ef-9f44db314698',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.333760] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a94f07d4-3f7f-43d2-b8ef-9f44db314698 [ 631.333968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.334111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.334183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.334399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.334490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.334581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a94f07d4-3f7f-43d2-b8ef-9f44db314698 already deleted. [ 631.334657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a94f07d4-3f7f-43d2-b8ef-9f44db314698" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.400268] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-f5565955-bf84-46ea-a4b5-9c3a3c8d6fd1 tempest-ServerActionsTestOtherA-1944985306 tempest-ServerActionsTestOtherA-1944985306-project-member] Enqueued Resource ID: b3585b8f-4551-42e2-b768-877c0ce343e2 with Priority: HIGHEST for action security_group_rules [ 631.400867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3585b8f-4551-42e2-b768-877c0ce343e2 with Priority: HIGHEST for action security_group_rules [ 631.401178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.401302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.401370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.401569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.401679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.401801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3585b8f-4551-42e2-b768-877c0ce343e2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.401899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.401960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.402107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.402183] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3585b8f-4551-42e2-b768-877c0ce343e2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.534561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3585b8f-4551-42e2-b768-877c0ce343e2 already deleted. [ 631.534561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3585b8f-4551-42e2-b768-877c0ce343e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.656430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-eef8bb0a-fa6f-4f0c-b874-001da92fefa2 None None] Enqueued Resource ID: da95d165-4c5a-4486-a5ab-7c9a4010cddf with Priority: HIGHEST for action port [ 632.656724] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da95d165-4c5a-4486-a5ab-7c9a4010cddf with Priority: HIGHEST for action port [ 632.657631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.657763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.657763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.657947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.658037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.658192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-da95d165-4c5a-4486-a5ab-7c9a4010cddf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.658290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da95d165-4c5a-4486-a5ab-7c9a4010cddf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.658356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da95d165-4c5a-4486-a5ab-7c9a4010cddf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.658550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da95d165-4c5a-4486-a5ab-7c9a4010cddf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.658637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da95d165-4c5a-4486-a5ab-7c9a4010cddf',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.752869] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da95d165-4c5a-4486-a5ab-7c9a4010cddf [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.752869] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da95d165-4c5a-4486-a5ab-7c9a4010cddf already deleted. [ 632.752869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da95d165-4c5a-4486-a5ab-7c9a4010cddf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.295057] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-96d1f96f-f708-4081-b054-ccaef0f7f8ed None None] Enqueued Resource ID: dbc04927-9eb8-4219-9616-0751664ad1a1 with Priority: HIGHEST for action port [ 633.299090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbc04927-9eb8-4219-9616-0751664ad1a1 with Priority: HIGHEST for action port [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbc04927-9eb8-4219-9616-0751664ad1a1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbc04927-9eb8-4219-9616-0751664ad1a1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbc04927-9eb8-4219-9616-0751664ad1a1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbc04927-9eb8-4219-9616-0751664ad1a1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.299090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc04927-9eb8-4219-9616-0751664ad1a1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.314493] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbc04927-9eb8-4219-9616-0751664ad1a1 [ 633.314935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.315212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.315392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.315700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.315910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.316136] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbc04927-9eb8-4219-9616-0751664ad1a1 already deleted. [ 633.316322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbc04927-9eb8-4219-9616-0751664ad1a1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.777180] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d1206b86-4154-428a-ac20-2a6a9decdc13 None None] Enqueued Resource ID: d4206729-f953-44fd-b13b-06e8ed0160b8 with Priority: HIGHEST for action port [ 633.777441] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4206729-f953-44fd-b13b-06e8ed0160b8 with Priority: HIGHEST for action port [ 633.778079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.778206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.778255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.778438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.778528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.778687] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4206729-f953-44fd-b13b-06e8ed0160b8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.778794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4206729-f953-44fd-b13b-06e8ed0160b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.778853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4206729-f953-44fd-b13b-06e8ed0160b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.779035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4206729-f953-44fd-b13b-06e8ed0160b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.779127] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4206729-f953-44fd-b13b-06e8ed0160b8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.917423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4206729-f953-44fd-b13b-06e8ed0160b8 [ 633.917423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.917636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.917636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.917772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.917862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.917954] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4206729-f953-44fd-b13b-06e8ed0160b8 already deleted. [ 633.918038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4206729-f953-44fd-b13b-06e8ed0160b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.092442] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-fae8fbd0-7992-4606-be33-1e3de818932c tempest-VolumesAdminNegativeTest-420285072 tempest-VolumesAdminNegativeTest-420285072-project-member] Enqueued Resource ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee with Priority: HIGHEST for action security_group_rules [ 635.092977] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee with Priority: HIGHEST for action security_group_rules [ 635.093345] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.093472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.093540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.093742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.093830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.093984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.094079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.094139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.094327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.094404] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b08d44a-8647-43f2-8dfe-2c8fbb3836ee',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.145667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.145869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.145920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.146191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.146302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.146403] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee already deleted. [ 635.146488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.229383] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5982e95d-4e50-41e8-852a-80d7511ca4ab tempest-VolumesAdminNegativeTest-420285072 tempest-VolumesAdminNegativeTest-420285072-project-member] Enqueued Resource ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee with Priority: HIGHEST for action security_group_rules [ 635.229962] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee with Priority: HIGHEST for action security_group_rules [ 635.230289] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.230413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.230480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.230681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.230770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.230926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.231024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.231086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.231263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.231336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b08d44a-8647-43f2-8dfe-2c8fbb3836ee',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.270342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.270724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.270902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.271239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.271472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.271934] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b08d44a-8647-43f2-8dfe-2c8fbb3836ee already deleted. [ 635.272348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b08d44a-8647-43f2-8dfe-2c8fbb3836ee" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.741587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5f326510-e159-40aa-807c-675f8e2e8743 None None] Enqueued Resource ID: 089022fe-c15f-4ead-aa13-bad862dc73fb with Priority: HIGHEST for action port [ 636.741824] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089022fe-c15f-4ead-aa13-bad862dc73fb with Priority: HIGHEST for action port [ 636.742625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.742625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.742625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.742810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.742863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.743029] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-089022fe-c15f-4ead-aa13-bad862dc73fb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.743142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-089022fe-c15f-4ead-aa13-bad862dc73fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.743195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-089022fe-c15f-4ead-aa13-bad862dc73fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.743367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-089022fe-c15f-4ead-aa13-bad862dc73fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.743445] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089022fe-c15f-4ead-aa13-bad862dc73fb',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.790264] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 089022fe-c15f-4ead-aa13-bad862dc73fb [ 636.790515] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.790632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.790697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.791010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.791010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.791089] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:089022fe-c15f-4ead-aa13-bad862dc73fb already deleted. [ 636.791151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-089022fe-c15f-4ead-aa13-bad862dc73fb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.808745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-24fa359d-3456-4ace-ab55-cb1c127e6d15 None None] Enqueued Resource ID: 0a678047-4b4c-4bc7-9d85-191f9c31ecbf with Priority: HIGHEST for action port [ 636.808745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a678047-4b4c-4bc7-9d85-191f9c31ecbf with Priority: HIGHEST for action port [ 636.808929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.809051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.809116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.809315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.809393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.809550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a678047-4b4c-4bc7-9d85-191f9c31ecbf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.809641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a678047-4b4c-4bc7-9d85-191f9c31ecbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.809700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a678047-4b4c-4bc7-9d85-191f9c31ecbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.809919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a678047-4b4c-4bc7-9d85-191f9c31ecbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.809995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a678047-4b4c-4bc7-9d85-191f9c31ecbf',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.847568] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a678047-4b4c-4bc7-9d85-191f9c31ecbf [ 636.847797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.847940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.848028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.848241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.848335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.848426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a678047-4b4c-4bc7-9d85-191f9c31ecbf already deleted. [ 636.848508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a678047-4b4c-4bc7-9d85-191f9c31ecbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.328175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bb0debb4-98fc-465b-aa79-a01f7d96a51f None None] Enqueued Resource ID: b140b316-1419-4b83-9da2-3fc41e145b83 with Priority: HIGHEST for action port [ 637.328175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b140b316-1419-4b83-9da2-3fc41e145b83 with Priority: HIGHEST for action port [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b140b316-1419-4b83-9da2-3fc41e145b83 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b140b316-1419-4b83-9da2-3fc41e145b83" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b140b316-1419-4b83-9da2-3fc41e145b83" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b140b316-1419-4b83-9da2-3fc41e145b83" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.328175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b140b316-1419-4b83-9da2-3fc41e145b83',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.355650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b140b316-1419-4b83-9da2-3fc41e145b83 [ 637.355650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.355756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.355756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.355955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.356122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.356161] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b140b316-1419-4b83-9da2-3fc41e145b83 already deleted. [ 637.356264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b140b316-1419-4b83-9da2-3fc41e145b83" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.850698] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e39f20f6-8155-49b6-a54d-e9613daafd98 None None] Enqueued Resource ID: 1694849d-8029-45d7-ab11-1f2cb5f3978f with Priority: HIGHEST for action port [ 638.850981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1694849d-8029-45d7-ab11-1f2cb5f3978f with Priority: HIGHEST for action port [ 638.851530] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.851652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.851719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.851915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.851998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.852167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1694849d-8029-45d7-ab11-1f2cb5f3978f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.852262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1694849d-8029-45d7-ab11-1f2cb5f3978f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.852324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1694849d-8029-45d7-ab11-1f2cb5f3978f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.852540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1694849d-8029-45d7-ab11-1f2cb5f3978f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.852615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1694849d-8029-45d7-ab11-1f2cb5f3978f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.866238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1694849d-8029-45d7-ab11-1f2cb5f3978f [ 638.866387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.866476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.866656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.866746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.866832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.866946] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1694849d-8029-45d7-ab11-1f2cb5f3978f already deleted. [ 638.867002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1694849d-8029-45d7-ab11-1f2cb5f3978f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.893966] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-beaf6f96-7e15-44b1-9620-124e398d8f04 tempest-AttachInterfacesUnderV243Test-662403438 tempest-AttachInterfacesUnderV243Test-662403438-project-member] Enqueued Resource ID: 12b102ce-0276-4b98-833c-70fc040908b8 with Priority: HIGHEST for action security_group_rules [ 639.894420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b102ce-0276-4b98-833c-70fc040908b8 with Priority: HIGHEST for action security_group_rules [ 639.894744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.894874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.894924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.895114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.895196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.895343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12b102ce-0276-4b98-833c-70fc040908b8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.895440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.895490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.895674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.895749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12b102ce-0276-4b98-833c-70fc040908b8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.942603] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.942790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.942871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.943083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.943177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.943275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12b102ce-0276-4b98-833c-70fc040908b8 already deleted. [ 639.943400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.113189] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-03e6a289-8a62-4bec-8494-aa729339e2a1 None None] Enqueued Resource ID: 08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0 with Priority: HIGHEST for action port [ 640.113189] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0 with Priority: HIGHEST for action port [ 640.113782] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.113899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.113964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.114264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.114264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.114388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.114481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.114540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.114727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.114801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.147363] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0 [ 640.147449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.147904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.147904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.147904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.148089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.148089] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0 already deleted. [ 640.148174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08d8c57f-ec65-4966-a1e5-a6a4f5a4b4a0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.303362] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6db8f86c-d16e-47ba-be1a-04a98733aefd tempest-AttachInterfacesUnderV243Test-662403438 tempest-AttachInterfacesUnderV243Test-662403438-project-member] Enqueued Resource ID: 12b102ce-0276-4b98-833c-70fc040908b8 with Priority: HIGHEST for action security_group_rules [ 640.303875] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b102ce-0276-4b98-833c-70fc040908b8 with Priority: HIGHEST for action security_group_rules [ 640.304220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.304345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.304413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.304619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.304724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.304887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12b102ce-0276-4b98-833c-70fc040908b8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.305042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.305042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.305191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.305269] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12b102ce-0276-4b98-833c-70fc040908b8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.337658] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-87fab0a3-2d48-491a-affb-0a9779fcc0d6 None None] Enqueued Resource ID: ea18a0cc-eae1-445d-aff9-8f7129759a6a with Priority: HIGHEST for action port [ 640.337658] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea18a0cc-eae1-445d-aff9-8f7129759a6a with Priority: HIGHEST for action port [ 640.337876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.338151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.338267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.338349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.338507] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea18a0cc-eae1-445d-aff9-8f7129759a6a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea18a0cc-eae1-445d-aff9-8f7129759a6a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.338663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea18a0cc-eae1-445d-aff9-8f7129759a6a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.338855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea18a0cc-eae1-445d-aff9-8f7129759a6a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.338932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea18a0cc-eae1-445d-aff9-8f7129759a6a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.368304] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea18a0cc-eae1-445d-aff9-8f7129759a6a [ 640.368540] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.368694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.368760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.368976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.369061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.369184] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea18a0cc-eae1-445d-aff9-8f7129759a6a already deleted. [ 640.369222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea18a0cc-eae1-445d-aff9-8f7129759a6a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.396131] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12b102ce-0276-4b98-833c-70fc040908b8 already deleted. [ 640.396131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12b102ce-0276-4b98-833c-70fc040908b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 641.820657] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8ae92c43-5976-432d-b677-14c9c09cf6c3 tempest-AttachSCSIVolumeTestJSON-1879792403 tempest-AttachSCSIVolumeTestJSON-1879792403-project-member] Enqueued Resource ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 with Priority: HIGHEST for action security_group_rules [ 641.821157] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 with Priority: HIGHEST for action security_group_rules [ 641.821515] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.821622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 641.821681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 641.821850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 641.821928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 641.822077] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.822169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 641.822229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 641.822417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 641.822491] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60cbb4ad-8df7-4c88-a985-78ad063ad4c2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.852974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.853113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 641.853256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 641.853366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 641.853462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 641.853558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 already deleted. [ 641.853644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.066151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-20aa9a69-8650-4c62-9603-a0911d258b42 tempest-AttachSCSIVolumeTestJSON-1879792403 tempest-AttachSCSIVolumeTestJSON-1879792403-project-member] Enqueued Resource ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 with Priority: HIGHEST for action security_group_rules [ 642.066151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 with Priority: HIGHEST for action security_group_rules [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.066151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60cbb4ad-8df7-4c88-a985-78ad063ad4c2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.123258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.123408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.123467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.123683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.123778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.123882] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60cbb4ad-8df7-4c88-a985-78ad063ad4c2 already deleted. [ 642.123963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60cbb4ad-8df7-4c88-a985-78ad063ad4c2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.520151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c330a0a7-7a9d-4ad3-919c-731e1372ab59 None None] Enqueued Resource ID: 5f86abf2-1493-43b0-8b7a-801459337eda with Priority: HIGHEST for action port [ 642.520441] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f86abf2-1493-43b0-8b7a-801459337eda with Priority: HIGHEST for action port [ 642.521051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.521179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.521248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.521432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.521514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.521659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f86abf2-1493-43b0-8b7a-801459337eda taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.521760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f86abf2-1493-43b0-8b7a-801459337eda" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.521811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f86abf2-1493-43b0-8b7a-801459337eda" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.521998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f86abf2-1493-43b0-8b7a-801459337eda" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.522063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f86abf2-1493-43b0-8b7a-801459337eda',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.566338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f86abf2-1493-43b0-8b7a-801459337eda [ 642.566546] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.566679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.566751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.566949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.567032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.567118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f86abf2-1493-43b0-8b7a-801459337eda already deleted. [ 642.567200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f86abf2-1493-43b0-8b7a-801459337eda" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.635000] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6ef97cc4-7bb3-416b-ab60-4986e96f128a None None] Enqueued Resource ID: 6c2b16f5-ee55-4947-a29a-504bd99f6800 with Priority: HIGHEST for action port [ 642.635511] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2b16f5-ee55-4947-a29a-504bd99f6800 with Priority: HIGHEST for action port [ 642.635846] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.635974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.636073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.636281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.636368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.636526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c2b16f5-ee55-4947-a29a-504bd99f6800 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.636841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c2b16f5-ee55-4947-a29a-504bd99f6800" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.636841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c2b16f5-ee55-4947-a29a-504bd99f6800" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.636929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c2b16f5-ee55-4947-a29a-504bd99f6800" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.636929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c2b16f5-ee55-4947-a29a-504bd99f6800',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.759515] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c2b16f5-ee55-4947-a29a-504bd99f6800 [ 642.759699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.759833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.759902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.760143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.760232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.760331] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c2b16f5-ee55-4947-a29a-504bd99f6800 already deleted. [ 642.760405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c2b16f5-ee55-4947-a29a-504bd99f6800" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 643.680864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-17f757ac-adca-44be-bbfe-03992c682fcd None None] Enqueued Resource ID: 3852a662-a52a-4d84-888c-8543b3e9b19a with Priority: HIGHEST for action port [ 643.681128] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3852a662-a52a-4d84-888c-8543b3e9b19a with Priority: HIGHEST for action port [ 643.681679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-3852a662-a52a-4d84-888c-8543b3e9b19a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3852a662-a52a-4d84-888c-8543b3e9b19a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 643.682803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3852a662-a52a-4d84-888c-8543b3e9b19a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 643.683127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3852a662-a52a-4d84-888c-8543b3e9b19a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 643.683127] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3852a662-a52a-4d84-888c-8543b3e9b19a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.725504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3852a662-a52a-4d84-888c-8543b3e9b19a [ 643.725728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.725860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 643.725928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 643.726306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 643.726306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 643.726306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3852a662-a52a-4d84-888c-8543b3e9b19a already deleted. [ 643.726493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3852a662-a52a-4d84-888c-8543b3e9b19a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.199185] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-132544f0-a7a8-4c47-8c97-da8bce4ff97e None None] Enqueued Resource ID: 67597699-b178-4e93-a301-111bdef5edcc with Priority: HIGHEST for action port [ 644.199436] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67597699-b178-4e93-a301-111bdef5edcc with Priority: HIGHEST for action port [ 644.200115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.200245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.200304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.200725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.200725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.200970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-67597699-b178-4e93-a301-111bdef5edcc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.200970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67597699-b178-4e93-a301-111bdef5edcc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.200970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67597699-b178-4e93-a301-111bdef5edcc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.201188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67597699-b178-4e93-a301-111bdef5edcc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.201188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67597699-b178-4e93-a301-111bdef5edcc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.212303] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67597699-b178-4e93-a301-111bdef5edcc [ 644.212541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.212852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.212943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.213162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.213441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.213441] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67597699-b178-4e93-a301-111bdef5edcc already deleted. [ 644.213441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67597699-b178-4e93-a301-111bdef5edcc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.475635] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-62f39aec-432b-4761-92cb-e80b35d263ef None None] Enqueued Resource ID: 7ac3c6b5-ec63-44e3-9296-e627d0e34212 with Priority: HIGHEST for action port [ 645.475916] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac3c6b5-ec63-44e3-9296-e627d0e34212 with Priority: HIGHEST for action port [ 645.476511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.476634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.476700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.476900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.476981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.477135] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac3c6b5-ec63-44e3-9296-e627d0e34212 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.477219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac3c6b5-ec63-44e3-9296-e627d0e34212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.477277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac3c6b5-ec63-44e3-9296-e627d0e34212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.477462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac3c6b5-ec63-44e3-9296-e627d0e34212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.477559] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac3c6b5-ec63-44e3-9296-e627d0e34212',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.486943] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ac3c6b5-ec63-44e3-9296-e627d0e34212 [ 645.487146] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.487267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.487336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.487546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.487644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.487738] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ac3c6b5-ec63-44e3-9296-e627d0e34212 already deleted. [ 645.487818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac3c6b5-ec63-44e3-9296-e627d0e34212" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 650.251826] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-62faa076-cad8-482f-b484-07b97de3ba52 None None] Enqueued Resource ID: 3b9473a7-2b82-4558-a095-c2b271d9da3b with Priority: HIGHEST for action port [ 650.251826] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9473a7-2b82-4558-a095-c2b271d9da3b with Priority: HIGHEST for action port [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9473a7-2b82-4558-a095-c2b271d9da3b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9473a7-2b82-4558-a095-c2b271d9da3b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9473a7-2b82-4558-a095-c2b271d9da3b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9473a7-2b82-4558-a095-c2b271d9da3b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 650.251826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9473a7-2b82-4558-a095-c2b271d9da3b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.261355] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b9473a7-2b82-4558-a095-c2b271d9da3b [ 650.261809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.262119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 650.262317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 650.262632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 650.262870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 650.263083] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b9473a7-2b82-4558-a095-c2b271d9da3b already deleted. [ 650.263391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9473a7-2b82-4558-a095-c2b271d9da3b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.684209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-266ac229-1c0d-4cd4-9f0c-a6982e5cabc1 None None] Enqueued Resource ID: 90a76654-b92b-49fa-a45d-999e7e055ce7 with Priority: HIGHEST for action port [ 652.684806] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a76654-b92b-49fa-a45d-999e7e055ce7 with Priority: HIGHEST for action port [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-90a76654-b92b-49fa-a45d-999e7e055ce7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90a76654-b92b-49fa-a45d-999e7e055ce7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90a76654-b92b-49fa-a45d-999e7e055ce7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90a76654-b92b-49fa-a45d-999e7e055ce7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.694718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a76654-b92b-49fa-a45d-999e7e055ce7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.707574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90a76654-b92b-49fa-a45d-999e7e055ce7 [ 652.707805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.707947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.708080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.708308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.708400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.708504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90a76654-b92b-49fa-a45d-999e7e055ce7 already deleted. [ 652.708617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90a76654-b92b-49fa-a45d-999e7e055ce7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.767230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-041ff139-9307-491a-a092-b38fc823d1da None None] Enqueued Resource ID: 74a82f67-f5c6-4cb1-9714-7ca9705436ed with Priority: HIGHEST for action port [ 656.767528] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a82f67-f5c6-4cb1-9714-7ca9705436ed with Priority: HIGHEST for action port [ 656.767964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.768100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.768167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.768364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.768448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.768645] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a82f67-f5c6-4cb1-9714-7ca9705436ed taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.769487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a82f67-f5c6-4cb1-9714-7ca9705436ed" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.769487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a82f67-f5c6-4cb1-9714-7ca9705436ed" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.769487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a82f67-f5c6-4cb1-9714-7ca9705436ed" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.769487] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a82f67-f5c6-4cb1-9714-7ca9705436ed',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.788279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74a82f67-f5c6-4cb1-9714-7ca9705436ed [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.788279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74a82f67-f5c6-4cb1-9714-7ca9705436ed already deleted. [ 656.788279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a82f67-f5c6-4cb1-9714-7ca9705436ed" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 658.934212] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5524bb29-79d3-45b5-97ca-3ef7a84303af None None] Enqueued Resource ID: 8603a6ee-b801-44a8-a0c0-ea9bc70a7271 with Priority: HIGHEST for action port [ 658.934491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8603a6ee-b801-44a8-a0c0-ea9bc70a7271 with Priority: HIGHEST for action port [ 658.935093] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.935215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 658.935280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 658.935482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 658.935586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 658.935748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8603a6ee-b801-44a8-a0c0-ea9bc70a7271 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.935841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8603a6ee-b801-44a8-a0c0-ea9bc70a7271" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 658.935901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8603a6ee-b801-44a8-a0c0-ea9bc70a7271" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 658.936122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8603a6ee-b801-44a8-a0c0-ea9bc70a7271" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 658.936197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8603a6ee-b801-44a8-a0c0-ea9bc70a7271',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.966656] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8603a6ee-b801-44a8-a0c0-ea9bc70a7271 [ 658.966656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.966771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 658.966802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 658.966995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 658.967080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 658.967171] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8603a6ee-b801-44a8-a0c0-ea9bc70a7271 already deleted. [ 658.967245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8603a6ee-b801-44a8-a0c0-ea9bc70a7271" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.167582] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-9ddd4677-1818-4851-a5d4-358fe058264f tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 663.168164] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 663.168491] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.168669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.168669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.168875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.168960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.169113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.169214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.169276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.169517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.169681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.169799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.169831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.170474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.170474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.170474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3559f066-18f1-4ff2-8555-b55b7bf9d8a7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.186194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.186342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.186998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.186998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.186998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.186998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.186998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.187334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.187334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.187334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.187334] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 already deleted. [ 663.187433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.535805] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c9ac51e1-6182-4803-b188-93d5ce634c2e tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 663.535805] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.535805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3559f066-18f1-4ff2-8555-b55b7bf9d8a7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.545572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 already deleted. [ 663.545572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.926580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-7d9f99c3-0a2b-4393-9153-94b7480e9448 tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 with Priority: HIGHEST for action security_group_rules [ 663.926580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 with Priority: HIGHEST for action security_group_rules [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.926580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384e8b80-8c0b-4c40-989d-75e41b3a50f2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.984189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.984189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.984189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.984189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.984450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.984947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 already deleted. [ 663.985101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 664.056638] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e81b2a13-9e31-46a1-b5f8-f86365f57100 tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 with Priority: HIGHEST for action security_group_rules [ 664.057158] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 with Priority: HIGHEST for action security_group_rules [ 664.057482] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.057674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 664.057738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 664.057939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 664.058351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 664.058351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.058351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 664.058351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 664.058539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 664.058624] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384e8b80-8c0b-4c40-989d-75e41b3a50f2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.097809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.097975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 664.098038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 664.098252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 664.098348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 664.098456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384e8b80-8c0b-4c40-989d-75e41b3a50f2 already deleted. [ 664.098559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384e8b80-8c0b-4c40-989d-75e41b3a50f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 669.058239] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 669.058524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 674.060882] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 674.060882] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 679.060447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 679.060790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 684.061494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 684.061494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 689.061992] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 689.062306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 694.063051] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 694.063333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 699.064401] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 699.064656] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 702.849750] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-efc7d3e9-8fa8-44f9-bebc-3b8d58e32b87 req-da1ded29-9918-4f83-a9f8-2fad9b97be6a tempest-ServersWithSpecificFlavorTestJSON-1283351527 tempest-ServersWithSpecificFlavorTestJSON-1283351527-project-member] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 702.849750] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGHEST for action security_group_members [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 702.849750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.859729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.860049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.860219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.860481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.860677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 702.860943] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.861167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.861317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.861550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.861727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 702.861895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 is going to be updated. [ 702.901899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.902023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 702.902076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 702.902289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 702.902454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 702.918302] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: IN_PROGRESS for 2s [ 704.160766] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-43a89827-b28c-4ce3-bd61-8c099b1bdbfc req-9cc2743c-1e55-4810-b074-17ca051b8217 tempest-TaggedAttachmentsTest-1196056706 tempest-TaggedAttachmentsTest-1196056706-project-member] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 704.161342] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 704.161709] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.161875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.161963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.162176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.162269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.162466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.162578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.162651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.162869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.163020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.163119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.163183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.163330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.163414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.163544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.185766] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.185908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.185976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.186182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.186556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.186556] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.186556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.186680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.186734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.186884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.186884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 already deleted. [ 704.186958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.780922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.781438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.781845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.781845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.781950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.782164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.782301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.782542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-5cd2e2fc-b43f-435f-a083-617d75c07338 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.782700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.782875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.783136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.783274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd2e2fc-b43f-435f-a083-617d75c07338',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.860768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.861003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.861134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.861410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.861569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.861731] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 5cd2e2fc-b43f-435f-a083-617d75c07338 not found, creating... [ 704.861990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.862152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.862274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.862494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.862638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.862919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.863076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.863197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.863484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.863640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.863787] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 5cd2e2fc-b43f-435f-a083-617d75c07338 is going to be created. [ 704.889746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.889980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 704.890110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 704.890503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 704.890752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.890986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 704.924368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 in Status: SUCCESS [ 704.924588] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 deletion is rescheduled due to dependency. [ 704.924861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.210367] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-43a89827-b28c-4ce3-bd61-8c099b1bdbfc req-b5f4cc0d-16cf-4e6d-9e96-9a021e7edc29 service neutron] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 705.210669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-43a89827-b28c-4ce3-bd61-8c099b1bdbfc req-b5f4cc0d-16cf-4e6d-9e96-9a021e7edc29 service neutron] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 705.210669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-43a89827-b28c-4ce3-bd61-8c099b1bdbfc req-b5f4cc0d-16cf-4e6d-9e96-9a021e7edc29 service neutron] Enqueued Resource ID: 5cd2e2fc-b43f-435f-a083-617d75c07338 with Priority: HIGHEST for action port [ 705.211172] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_rules [ 705.211311] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 705.211412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd2e2fc-b43f-435f-a083-617d75c07338 with Priority: HIGHEST for action port [ 705.211681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.211808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.211915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.212087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.212166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.212314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.212407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.212466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.212606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.212684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.213940] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.214048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.214115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.214256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.214335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.214476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.214561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.214620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.214989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.215172] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.215307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.215375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.215524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.215608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.215695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.216462] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.216561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.216624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.216775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.216851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.216993] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cd2e2fc-b43f-435f-a083-617d75c07338 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.217086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.217148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.217336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.217426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd2e2fc-b43f-435f-a083-617d75c07338',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.230052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.243351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.245162] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.246473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.248133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.248409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.248516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.248736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.248837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.249672] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cd2e2fc-b43f-435f-a083-617d75c07338 with status ACTIVE [ 705.249869] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.249981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.250051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.250237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.250324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.250570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.250632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.250665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.250809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.250887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.252578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.252700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.252739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.252890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.252967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.253053] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be created. [ 705.284505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.284777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.284777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.284926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.285160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.295831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: UNINITIALIZED for 2s [ 705.599405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.599586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.599626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.599844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.599944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.600055] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cd2e2fc-b43f-435f-a083-617d75c07338 is going to be updated. [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 705.622334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cd2e2fc-b43f-435f-a083-617d75c07338" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.305628] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: SUCCESS [ 707.305894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.306964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 707.307177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 707.307355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 707.307633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 707.307793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 707.307876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.307965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.308169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.323493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.331149] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e71d03b6-2bab-4f24-a6ee-b9da8e938815: rpc.has_security_group_logging(os_id): False [ 707.350738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.350929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 707.350975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 707.351176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 707.351270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.351582] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.351702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 707.351765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 707.351955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 707.352061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.352153] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be created. [ 707.437282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.437434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 707.437501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 707.438080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 707.438288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 707.455110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: IN_PROGRESS for 2s [ 709.470454] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: SUCCESS [ 709.470753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 710.212451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 710.212498] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 713.439285] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-109b1bb2-63bb-4b9f-8b9c-4da5e56ac9a3 req-8693a73f-73f4-4b1e-b59d-0e6470a035fb tempest-ServerActionsTestJSON-25147579 tempest-ServerActionsTestJSON-25147579-project-member] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 713.439875] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 713.440227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.440363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 713.440431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 713.440628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 713.440709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 713.440862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.440947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 713.441008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 713.441185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 713.441329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.441420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 713.441479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 713.441618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 713.441699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 713.441817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.454001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.454129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 713.454195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 713.454395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 713.454486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 713.454677] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.454780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 713.454842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 713.455013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 713.455094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 713.455202] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 already deleted. [ 713.455331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.022688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.022904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.023037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.023308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.023465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.023717] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-108 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.023885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-108" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.024014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-108" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.024361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-108" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.024967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.024967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.024967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.025192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.025225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.025380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-108" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.025721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.025891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.026015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.026250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.026356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.026715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-94f095dd-5bb1-4266-a64a-c06dde239855 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.026881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.027004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.027256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.027402] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94f095dd-5bb1-4266-a64a-c06dde239855',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.044918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.045164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.045295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.045576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.045724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.045881] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 94f095dd-5bb1-4266-a64a-c06dde239855 not found, creating... [ 714.046156] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.046322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.046486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.046676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.047010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.047818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.048104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.048104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.048342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.048634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 94f095dd-5bb1-4266-a64a-c06dde239855 is going to be created. [ 714.070106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.070331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 714.070459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 714.070735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 714.071149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 714.071187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.046665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-109b1bb2-63bb-4b9f-8b9c-4da5e56ac9a3 req-f71c8d6f-5eaa-4e9b-88d0-85560a2ff634 service neutron] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 715.046961] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-109b1bb2-63bb-4b9f-8b9c-4da5e56ac9a3 req-f71c8d6f-5eaa-4e9b-88d0-85560a2ff634 service neutron] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 715.047006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-109b1bb2-63bb-4b9f-8b9c-4da5e56ac9a3 req-f71c8d6f-5eaa-4e9b-88d0-85560a2ff634 service neutron] Enqueued Resource ID: 94f095dd-5bb1-4266-a64a-c06dde239855 with Priority: HIGHEST for action port [ 715.047505] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_rules [ 715.047713] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 715.047817] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94f095dd-5bb1-4266-a64a-c06dde239855 with Priority: HIGHEST for action port [ 715.048124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.048252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.048320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.048530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.048660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.048863] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.048969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.049034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.049197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.049277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.050142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.050256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.050321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.050477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.050556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.050701] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.050794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.050856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.050995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.051132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.051222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.051283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.051418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.051495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.051578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.052683] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.052791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.052860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.053040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.053120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.053265] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-94f095dd-5bb1-4266-a64a-c06dde239855 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.053359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.053422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.053727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.053727] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94f095dd-5bb1-4266-a64a-c06dde239855',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.084082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.097917] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.098069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.098138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.098340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.098420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.098583] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.098697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.101192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.105113] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94f095dd-5bb1-4266-a64a-c06dde239855 with status ACTIVE [ 715.105292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.105408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.105498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.105708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.105796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.105976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.106070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.106130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.106276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.106350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.112124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.112264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.112305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.112929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.112929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.112929] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be created. [ 715.153002] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.153164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.153227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.153443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.153610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.163797] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: UNINITIALIZED for 2s [ 715.433237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.433429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.433468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.433662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.433755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.433849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94f095dd-5bb1-4266-a64a-c06dde239855 is going to be updated. [ 715.455715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.455715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 715.455715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 715.460172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 715.460172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 715.460172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94f095dd-5bb1-4266-a64a-c06dde239855" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.148706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-51ad2f14-8edd-4f3d-8827-ebf76e9524f3 None None] Enqueued Resource ID: 1ad41cb9-463b-4b41-a722-296485d6fcad with Priority: HIGHEST for action port [ 717.148968] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ad41cb9-463b-4b41-a722-296485d6fcad with Priority: HIGHEST for action port [ 717.149525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.149651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.149719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.149928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.150008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.150163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ad41cb9-463b-4b41-a722-296485d6fcad taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.150257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ad41cb9-463b-4b41-a722-296485d6fcad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.150320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ad41cb9-463b-4b41-a722-296485d6fcad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.150514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ad41cb9-463b-4b41-a722-296485d6fcad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.150594] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ad41cb9-463b-4b41-a722-296485d6fcad',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.173632] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: SUCCESS [ 717.173855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.174015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.174224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.174408] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.174529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.174596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.174748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.174832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.174920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.175007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.176609] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ad41cb9-463b-4b41-a722-296485d6fcad [ 717.176795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.176925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.176964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.177111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.177192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.177276] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ad41cb9-463b-4b41-a722-296485d6fcad already deleted. [ 717.177352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ad41cb9-463b-4b41-a722-296485d6fcad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.188970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.201349] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa91f3d7-2dd6-42f5-ad5c-5e8869447833: rpc.has_security_group_logging(os_id): False [ 717.215595] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.215738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.215800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.216063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.216109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.216333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.216769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.216840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.216997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.217078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.217170] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be created. [ 717.279467] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.280151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 717.280357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 717.280650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 717.281379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 717.294150] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: IN_PROGRESS for 2s [ 719.016045] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-9289fb30-0690-4b22-8b25-28d192211e9b None None] Enqueued Resource ID: 0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae with Priority: HIGHEST for action port [ 719.016994] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae with Priority: HIGHEST for action port [ 719.017290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.017429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 719.017476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 719.017966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 719.017966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 719.017966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.018133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 719.018133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 719.018270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 719.018343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.061486] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae [ 719.061721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.061829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 719.061883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 719.062140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 719.062185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 719.062282] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae already deleted. [ 719.062362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f8440d9-3aaa-4e06-af28-27dc3ec3f1ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 719.307898] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: SUCCESS [ 719.308216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 724.018216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 724.018543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 729.019481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 729.019753] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 734.020371] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 734.020676] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 739.021290] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 739.021599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 744.022363] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 744.022685] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 749.024488] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 749.024488] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 749.823719] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 749.823719] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:1 started [ 752.621095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-935abcbe-87ec-40d6-a6eb-55bfc1cb6f3c req-d73c1af2-e085-4d65-88fa-58306aa17e89 tempest-VolumesAssistedSnapshotsTest-322351418 tempest-VolumesAssistedSnapshotsTest-322351418-project-member] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 752.621625] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGHEST for action security_group_members [ 752.621992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.622130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.622177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.622397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.622485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 752.622692] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.622851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.622882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.623085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.623204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.623298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.623502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.623681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.623786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 752.623876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.640163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.640312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.640384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.640594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.640728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 752.640934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.641037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.641097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.641249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.641326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 752.641410] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1158288-998a-4271-bc1a-cf68dc491870 is going to be updated. [ 752.671555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.671555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 752.671555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 752.671555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 752.671555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 752.679956] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: IN_PROGRESS for 2s [ 753.816422] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b9ee6d24-9a40-47f1-b39f-8fc795e35ed1 req-6c385d52-1813-4d5c-9175-647323e7731f tempest-ServersAdminTestJSON-1987698982 tempest-ServersAdminTestJSON-1987698982-project-member] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 753.816950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 753.817273] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.817400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 753.817469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 753.817723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 753.817805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 753.817965] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.818063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 753.818125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 753.818328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 753.818496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.818597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 753.818661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 753.818800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 753.818876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 753.818968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.827640] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.827805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 753.827878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 753.828071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 753.828162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 753.828346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.828446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 753.828526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 753.828679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 753.828761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 753.828849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 already deleted. [ 753.828927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.142366] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.143336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.143336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.143336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.143336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.143526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.143526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.143641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.143882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.144141] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.144300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.144418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.144622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.144760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.144904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.145153] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.145298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.145412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.145614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.145742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.145976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-a19e8c2e-80b0-4986-8485-f7e977fc2a79 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.146124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.146238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.146481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.146622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a19e8c2e-80b0-4986-8485-f7e977fc2a79',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.163083] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.163083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.163083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.163083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.163581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.163581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port a19e8c2e-80b0-4986-8485-f7e977fc2a79 not found, creating... [ 754.163581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.163779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.163848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.164079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.164222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.164632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.164733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.164770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.164964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.165101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.165245] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: a19e8c2e-80b0-4986-8485-f7e977fc2a79 is going to be created. [ 754.186498] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.186706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.186825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.187166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.187419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.187694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.492929] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b9ee6d24-9a40-47f1-b39f-8fc795e35ed1 req-26d09e56-b9e8-45c4-a7a6-4256d678927f service neutron] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_rules [ 754.493101] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b9ee6d24-9a40-47f1-b39f-8fc795e35ed1 req-26d09e56-b9e8-45c4-a7a6-4256d678927f service neutron] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 754.493238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b9ee6d24-9a40-47f1-b39f-8fc795e35ed1 req-26d09e56-b9e8-45c4-a7a6-4256d678927f service neutron] Enqueued Resource ID: a19e8c2e-80b0-4986-8485-f7e977fc2a79 with Priority: HIGHEST for action port [ 754.493448] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_rules [ 754.493569] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 754.493662] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a19e8c2e-80b0-4986-8485-f7e977fc2a79 with Priority: HIGHEST for action port [ 754.494510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.494641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.494706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.494902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.494979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.495134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.495227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.495285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.495484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.495560] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.496421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.496521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.496585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.496734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.496806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.496943] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.497031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.497090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.497225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.497354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.497441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.497498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.497698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.497775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.497855] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.498595] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.498714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.498780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.498927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.498997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.499137] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a19e8c2e-80b0-4986-8485-f7e977fc2a79 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.499220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.499310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.499410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.499474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a19e8c2e-80b0-4986-8485-f7e977fc2a79',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.515825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.525310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.525310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.525310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.525310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.525562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.525562] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.525675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.532044] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.537146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a19e8c2e-80b0-4986-8485-f7e977fc2a79 with status ACTIVE [ 754.537368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.537494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.537575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.537798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.537893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.538077] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.538176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.538239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.538385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.538464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.542732] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.542889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.542947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.543164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.543289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.543413] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be created. [ 754.570871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.571092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.571143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.571346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.571519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.581513] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: UNINITIALIZED for 2s [ 754.688743] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1158288-998a-4271-bc1a-cf68dc491870 in Status: SUCCESS [ 754.688957] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1158288-998a-4271-bc1a-cf68dc491870 deletion is rescheduled due to dependency. [ 754.689049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.973843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.973843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.973843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.973843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.973843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.973843] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a19e8c2e-80b0-4986-8485-f7e977fc2a79 is going to be updated. [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 754.998228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a19e8c2e-80b0-4986-8485-f7e977fc2a79" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.591490] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: SUCCESS [ 756.591759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.591872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.592112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.592309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.592431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.592495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.592652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.592739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.592828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.592923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.602652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.602832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.602877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.603056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.603136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.603688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.603688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.603688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.603688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.603688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.603919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.603919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.603976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.604122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.604122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.604276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.604363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.604422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.604557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.604630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.604770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.604860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.604921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.605050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.605184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.605272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.605331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.605858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.605940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.606027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.606115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.621220] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dccfe94-a28c-458f-a44d-bf0826c447a8: rpc.has_security_group_logging(os_id): False [ 756.638958] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.639139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.639219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.639431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.639523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.639780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.639872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.639959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.640144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.640222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.640417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.640509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.640567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.640703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.640775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.640953] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.641061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.641151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.641364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.641446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.641532] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be created. [ 756.698242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.698399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 756.698471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 756.698727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 756.698927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 756.711553] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: IN_PROGRESS for 2s [ 758.724580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: SUCCESS [ 758.724864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 759.494176] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 759.494267] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 764.495734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 764.496074] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 764.875883] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-95286149-51de-4d02-8e5e-cdeb294ddae9 req-93b25c87-c7c0-4b53-9d79-90926ba45f16 tempest-ServersTestFqdnHostnames-913108469 tempest-ServersTestFqdnHostnames-913108469-project-member] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 764.876392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 764.876743] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.876907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 764.876937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 764.877168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 764.877218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 764.877376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.877487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 764.877532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 764.878036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 764.878036] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.878036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 764.878036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 764.878174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 764.878240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 764.878332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.888496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.888496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 764.888640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 764.888799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 764.888893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 764.889086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.889191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 764.889267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 764.889468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 764.889515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 764.889590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 already deleted. [ 764.889670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.356651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.356856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.356985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.357267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.357416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.357708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-850 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.357869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-850" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.357993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-850" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.358265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-850" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.358513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.358704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.358849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.359034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.359176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.359442] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.359600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.359722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.359985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.360150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.360302] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: Segment with ID: nsx-vlan-transportzone-850 is going to be created. [ 765.391418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.391649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.391783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.392086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.392315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.392545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-850" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.392835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.393125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.393125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.393346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.393485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.393734] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-dcefbabc-ae23-48fb-9557-7423f48afc2e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.393896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.394020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.394810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.394810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcefbabc-ae23-48fb-9557-7423f48afc2e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.411733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.411986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.412165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.412444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.412599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.412763] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port dcefbabc-ae23-48fb-9557-7423f48afc2e not found, creating... [ 765.413026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.413206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.413300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.413517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.413664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.413952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.414111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.414230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.414440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.414578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.414723] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: dcefbabc-ae23-48fb-9557-7423f48afc2e is going to be created. [ 765.434360] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.434578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.434713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.435119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.435380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.435613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.738415] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-95286149-51de-4d02-8e5e-cdeb294ddae9 req-53f12930-0c69-49e4-beba-4416c326dc9a service neutron] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 765.738784] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-95286149-51de-4d02-8e5e-cdeb294ddae9 req-53f12930-0c69-49e4-beba-4416c326dc9a service neutron] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 765.738784] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-95286149-51de-4d02-8e5e-cdeb294ddae9 req-53f12930-0c69-49e4-beba-4416c326dc9a service neutron] Enqueued Resource ID: dcefbabc-ae23-48fb-9557-7423f48afc2e with Priority: HIGHEST for action port [ 765.739217] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_rules [ 765.739356] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 765.739455] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcefbabc-ae23-48fb-9557-7423f48afc2e with Priority: HIGHEST for action port [ 765.739746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.744890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcefbabc-ae23-48fb-9557-7423f48afc2e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.745779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcefbabc-ae23-48fb-9557-7423f48afc2e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.762243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.770201] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.770339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.770408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.770617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.770703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.770864] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.770945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.772808] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcefbabc-ae23-48fb-9557-7423f48afc2e with status ACTIVE [ 765.772982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.773095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.773164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.773339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.773424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.773591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.773687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.773750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.773890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.773966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.775706] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.783010] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.783136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.783205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.783391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.783477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.783569] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be created. [ 765.825801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.825955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 765.826026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 765.826238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 765.826403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.838940] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: UNINITIALIZED for 2s [ 766.210502] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.210757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 766.210757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 766.210941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 766.211039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 766.211135] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcefbabc-ae23-48fb-9557-7423f48afc2e is going to be updated. [ 766.232194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.232357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 766.232431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 766.232717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 766.232946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 766.233128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcefbabc-ae23-48fb-9557-7423f48afc2e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.848946] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: SUCCESS [ 767.849231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.849372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 767.849584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 767.849774] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.849915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 767.849979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 767.850132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 767.850254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.850289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.850377] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.870059] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.886563] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4801f783-8dbc-45ec-a773-4c5f10604f95: rpc.has_security_group_logging(os_id): False [ 767.904279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.904424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 767.904494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 767.904706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 767.904800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.905039] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.905146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 767.905211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 767.905364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 767.905448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.905535] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be created. [ 767.970773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.970953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 767.971025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 767.971244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 767.971431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 767.983626] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: IN_PROGRESS for 2s [ 770.001048] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: SUCCESS [ 770.001369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 770.740389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.740503] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 775.741338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 775.741698] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 780.742357] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 780.742640] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 781.706934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.707102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 781.707161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 781.707381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 781.707503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 781.707830] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.707957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 781.708038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 781.708213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 781.708320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.716849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.724204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.730690] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 781.730790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 782.324857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.325248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.325248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.325248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.464196] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 782.464656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.465509] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 782.501079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.501237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.501307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.501533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.513192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.513942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 782.514028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'bc00d8f6-d7bd-494e-9618-e2ca13dadfc6'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 782.514100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 782.538686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.538788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.538850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.539061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.539516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.539650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 782.579230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.579419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.579419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.579611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.579848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.580034] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 782.616178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.616336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.616406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.616621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.616797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.616959] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 782.617038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e1158288-998a-4271-bc1a-cf68dc491870', 'fa91f3d7-2dd6-42f5-ad5c-5e8869447833', '5054886e-af25-43c4-9482-725da5a36a84', '8041be8d-e946-4047-8d48-0e5c8a8422c0', '7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469', '4801f783-8dbc-45ec-a773-4c5f10604f95', '7dccfe94-a28c-458f-a44d-bf0826c447a8', 'e71d03b6-2bab-4f24-a6ee-b9da8e938815'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 782.617110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 782.635416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.635582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.635657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.635870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.635957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.636084] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 782.636156] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 782.636228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 782.676762] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.676922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.676991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.677207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.677630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.677804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 782.677880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 782.677947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 782.678012] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 782.678092] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc00d8f6-d7bd-494e-9618-e2ca13dadfc6 with Priority: HIGH for action port [ 782.678173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 782.678235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGH for action security_group_rules [ 782.678299] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 782.678362] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_rules [ 782.678423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_rules [ 782.678484] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGH for action security_group_rules [ 782.678558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 782.678634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 782.678696] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 782.678764] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 782.678827] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 782.679005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.679108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.679170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.679324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.679445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.679588] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.679654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.679712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.679848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.679921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.680096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.680189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.680245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.680380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.680452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.680614] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.680705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.680763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.680897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.681041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.681127] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.681216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.681275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.681409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.681480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.681641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.681732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.681791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.681923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.681995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.682160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.682249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.682308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.682442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.682514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.682676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.682766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.682825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.682957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.683028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.683189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.683278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.683500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.683500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.683598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.683680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.683770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.683828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.683961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.684043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.684206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.684293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.684352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.684483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.684554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.684714] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.684800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.684859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.684989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.685059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.685218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.685305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.685361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.685493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.685565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.685725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.685812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.685868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.685998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.686068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.686230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.686315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.686372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.686503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.686575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.686736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.686822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.686879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.687010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.687081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.687240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.687327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.687383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.687512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.687597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.687760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.687852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.687910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.688064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.688137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.688299] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.688387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.688444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.688597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.688675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.688841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.688929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.688988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.689123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.689194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.689354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.689441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.689500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.689633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.689706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.689899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.689964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.690000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.690132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.690204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.690363] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.690450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 782.690508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 782.690642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 782.690714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 782.690808] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:9 [ 782.690873] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 9 of least updated resources [ 782.690947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7 with Priority: HIGH for action security_group_members [ 782.691024] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9aab864d-34fe-4cd4-9552-550bb898f42d with Priority: HIGH for action security_group_members [ 782.691158] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81f07a25-7f23-4cf0-a88f-6021f3666c52 with Priority: HIGH for action security_group_members [ 782.691158] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 with Priority: HIGH for action security_group_members [ 782.691237] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32be7111-86e1-4ffe-ac53-4ce14e5053d4 with Priority: HIGH for action security_group_members [ 782.691271] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ded21cce-1525-4f7f-9b6b-133b85500a0d with Priority: HIGH for action security_group_members [ 782.691321] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f12b0f33-809c-425e-8e13-5ad0ffcd397c with Priority: HIGH for action security_group_members [ 782.691383] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a89631c9-8132-4989-9c86-ff50023987ca with Priority: HIGH for action security_group_members [ 782.691449] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce64a6de-f08d-452e-950a-54c4274aeb47 with Priority: HIGH for action security_group_members [ 782.691540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.743318] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 785.743588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=18], Jobs=0 [ 785.743633] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc00d8f6-d7bd-494e-9618-e2ca13dadfc6 with Priority: HIGH for action port [ 785.743755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 785.743932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 785.743970] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded21cce-1525-4f7f-9b6b-133b85500a0d with Priority: HIGH for action security_group_members [ 785.744051] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce64a6de-f08d-452e-950a-54c4274aeb47 with Priority: HIGH for action security_group_members [ 785.744148] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89631c9-8132-4989-9c86-ff50023987ca with Priority: HIGH for action security_group_members [ 785.744242] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32be7111-86e1-4ffe-ac53-4ce14e5053d4 with Priority: HIGH for action security_group_members [ 785.744333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12b0f33-809c-425e-8e13-5ad0ffcd397c with Priority: HIGH for action security_group_members [ 785.744423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 with Priority: HIGH for action security_group_members [ 785.744511] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81f07a25-7f23-4cf0-a88f-6021f3666c52 with Priority: HIGH for action security_group_members [ 785.744637] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aab864d-34fe-4cd4-9552-550bb898f42d with Priority: HIGH for action security_group_members [ 785.744733] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7 with Priority: HIGH for action security_group_members [ 785.744822] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 785.744998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGH for action security_group_rules [ 785.744998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 785.745060] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_rules [ 785.745147] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGH for action security_group_rules [ 785.745231] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_rules [ 785.745604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.745770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.745837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.746050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.746144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.746319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc00d8f6-d7bd-494e-9618-e2ca13dadfc6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.746408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc00d8f6-d7bd-494e-9618-e2ca13dadfc6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.746477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc00d8f6-d7bd-494e-9618-e2ca13dadfc6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.746725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc00d8f6-d7bd-494e-9618-e2ca13dadfc6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.746837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc00d8f6-d7bd-494e-9618-e2ca13dadfc6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.747845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.747960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.748047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.748197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.748276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.748423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.748518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.748588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.748713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.748786] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.749810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.749935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.750224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.750308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.750387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.750531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.750626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.750684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.750834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.750962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.751791] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.751949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.752016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.752189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.752307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.752422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded21cce-1525-4f7f-9b6b-133b85500a0d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.752516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded21cce-1525-4f7f-9b6b-133b85500a0d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.752578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded21cce-1525-4f7f-9b6b-133b85500a0d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.752750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded21cce-1525-4f7f-9b6b-133b85500a0d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.752922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.753103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.753103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.753240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.753301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.753386] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded21cce-1525-4f7f-9b6b-133b85500a0d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.754129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.754248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.754340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.754524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.754613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.754780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce64a6de-f08d-452e-950a-54c4274aeb47 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.754924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce64a6de-f08d-452e-950a-54c4274aeb47" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.754924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce64a6de-f08d-452e-950a-54c4274aeb47" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.755106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce64a6de-f08d-452e-950a-54c4274aeb47" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.755300] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.755427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.755553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.755649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.755749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.755898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce64a6de-f08d-452e-950a-54c4274aeb47',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.756616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.756692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.756802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.756976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.757033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.757258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89631c9-8132-4989-9c86-ff50023987ca taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.757258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89631c9-8132-4989-9c86-ff50023987ca" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.757399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89631c9-8132-4989-9c86-ff50023987ca" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.757529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89631c9-8132-4989-9c86-ff50023987ca" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.757675] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.757775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.757835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.757972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.758041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.758126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89631c9-8132-4989-9c86-ff50023987ca',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.758904] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.759072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.759246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.759352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.759503] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-32be7111-86e1-4ffe-ac53-4ce14e5053d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32be7111-86e1-4ffe-ac53-4ce14e5053d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.759703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32be7111-86e1-4ffe-ac53-4ce14e5053d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.759884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32be7111-86e1-4ffe-ac53-4ce14e5053d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.760059] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.760194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.760284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.760443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.760514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.760615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32be7111-86e1-4ffe-ac53-4ce14e5053d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.761376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.761492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.761554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.761708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.761787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.761930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12b0f33-809c-425e-8e13-5ad0ffcd397c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.762019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12b0f33-809c-425e-8e13-5ad0ffcd397c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.762076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12b0f33-809c-425e-8e13-5ad0ffcd397c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.762287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12b0f33-809c-425e-8e13-5ad0ffcd397c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.762433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.762542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.762631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.762783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.762861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.762961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f12b0f33-809c-425e-8e13-5ad0ffcd397c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.763688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.763792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.763881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.764020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.764083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-22e80e7c-32cc-4414-a8d7-6873395a6099 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.765124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.765438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.765438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.765504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22e80e7c-32cc-4414-a8d7-6873395a6099',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.766324] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.766382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.766445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.766592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.766666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.766805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-81f07a25-7f23-4cf0-a88f-6021f3666c52 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.766923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81f07a25-7f23-4cf0-a88f-6021f3666c52" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.766953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81f07a25-7f23-4cf0-a88f-6021f3666c52" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.767144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81f07a25-7f23-4cf0-a88f-6021f3666c52" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.767279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.767368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.767425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.767563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.767656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.767732] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81f07a25-7f23-4cf0-a88f-6021f3666c52',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.768491] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.768600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.768683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.768803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.768875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.769065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aab864d-34fe-4cd4-9552-550bb898f42d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.769161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aab864d-34fe-4cd4-9552-550bb898f42d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.769212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aab864d-34fe-4cd4-9552-550bb898f42d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.769374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aab864d-34fe-4cd4-9552-550bb898f42d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.769505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.769595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.769657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.769796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.769861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.769925] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aab864d-34fe-4cd4-9552-550bb898f42d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.770600] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.770719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.770764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.770908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.770978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.771130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.771223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.771261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.771414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.771544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.771680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.771680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.771809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.771901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.771970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.772680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.772800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.772845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.772985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.773057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.773192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.773303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.773395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.773544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.773618] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.774380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.774510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.774575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.774721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.774792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.774929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.775015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.775072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.775205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.775269] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.776089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.776174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.776174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.776315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.776385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.776555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.776608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.776668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.776801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.776866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.777526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.777631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.777694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.777837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.777907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.778041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.778127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.778184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.778316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.778388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.779119] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.779224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.779287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.779430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.779501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.779648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.779735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.779800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.779927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.779991] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.780674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.780778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.780842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.780987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.781060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.781196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.781284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.781340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.781483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.781541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.784228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc00d8f6-d7bd-494e-9618-e2ca13dadfc6 [ 785.784395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.784500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.784562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.784715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.784797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.786418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.786521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.786588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.786737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.786821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.787021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.787071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.787128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.787268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.787348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.787433] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded21cce-1525-4f7f-9b6b-133b85500a0d is going to be deleted. [ 785.789411] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.789517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.789589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.789746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.789829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.789995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.790091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.790150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.790290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.790364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.790496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce64a6de-f08d-452e-950a-54c4274aeb47 is going to be deleted. [ 785.791328] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.791435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.791499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.791650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.791734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.791899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.791997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.792096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.792232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.792313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.792399] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89631c9-8132-4989-9c86-ff50023987ca is going to be deleted. [ 785.811838] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.811977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.812059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.812388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.812474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.812695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.812804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.812865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.813026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.813194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.813279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.813314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.813491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.813527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.813593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.813676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.814648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.814731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.814795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.814947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.815028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.815198] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.815304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.815364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.815505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.815580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.815664] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f12b0f33-809c-425e-8e13-5ad0ffcd397c is going to be deleted. [ 785.816884] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.816961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.816961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.817112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.817187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.817351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.817441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.817500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.817648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.817720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.817799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22e80e7c-32cc-4414-a8d7-6873395a6099 is going to be deleted. [ 785.820357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.820461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.820527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.820695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.820851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.820922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.821014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.821124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.821262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.821297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.821348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81f07a25-7f23-4cf0-a88f-6021f3666c52 is going to be deleted. [ 785.834496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.834666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.834706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.834893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.834972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.835134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.835229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.835289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.835433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.835583] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.835672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.835729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.835860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.835933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.836048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.836132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.845067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.851286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.853843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.853972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.854037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.854242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.854333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.854429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce64a6de-f08d-452e-950a-54c4274aeb47" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.858018] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.858147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.859124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.859124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.859124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.859124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89631c9-8132-4989-9c86-ff50023987ca" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.859930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.860082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.860135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.860305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.860409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.860596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.860781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.860781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.860891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.860969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.861056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32be7111-86e1-4ffe-ac53-4ce14e5053d4 is going to be deleted. [ 785.862873] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.862932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.862988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.863145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.863226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.863340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12b0f33-809c-425e-8e13-5ad0ffcd397c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.863995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.864149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.864218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.864368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.864449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.864541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22e80e7c-32cc-4414-a8d7-6873395a6099" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.865190] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.865300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.865368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.865514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.865593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.865684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81f07a25-7f23-4cf0-a88f-6021f3666c52" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.866308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.866365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.866424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.866568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.866695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.866741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded21cce-1525-4f7f-9b6b-133b85500a0d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.869541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.869646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.869725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.869887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.870046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.870216] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.870341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.870381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.870507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.870580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.870664] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7 is going to be deleted. [ 785.876299] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.876414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.876480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.876649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.898381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.898576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.900263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.900381] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 is going to be deleted. [ 785.902873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.903098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.904598] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.904722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.904791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.904980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.905112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.905246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1060fe54-76ec-4e9c-9bbd-1e7e4e5376b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.905890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.906005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.906074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.906229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.906311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.906403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32be7111-86e1-4ffe-ac53-4ce14e5053d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.931158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.931334] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1158288-998a-4271-bc1a-cf68dc491870 is going to be deleted. [ 785.938402] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa91f3d7-2dd6-42f5-ad5c-5e8869447833: rpc.has_security_group_logging(os_id): False [ 785.939712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.939852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.939908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.940127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.940213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.940398] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.940494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.940553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.940694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.940873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.940873] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aab864d-34fe-4cd4-9552-550bb898f42d is going to be deleted. [ 785.942486] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.942584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.942652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.942804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.942878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.943021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.943111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.943169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.943321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.943453] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.943541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.943598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.943730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.943801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.943878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.943959] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.944825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.944922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.944991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.945140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.945214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.945360] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.945448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.945507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.945685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.945827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.945918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.945976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.946125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.946188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.946267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.946348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.949596] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4801f783-8dbc-45ec-a773-4c5f10604f95: rpc.has_security_group_logging(os_id): False [ 785.950647] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.950767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.950850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.951025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.951105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.951256] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.951347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.951404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.951542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.951691] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.951779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.951837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.951970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.952067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.952150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.952232] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.953106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.953212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.953275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.953427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.953500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.953643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.953726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.953786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.953921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.954053] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.954140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.954195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.954327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.954398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.954476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.954567] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.956181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.956286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.956349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.956499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.956574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.956718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.956807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.956866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.957000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.957131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.957217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.957268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.957410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.957467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.957543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.957712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.957801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.957858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.957989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.958058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.958192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.958276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.958333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.958461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.958621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.958716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.958772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.958905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.958974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.959051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.959128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.961197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.964561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.964681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.964734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.964910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.964994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.965120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc00d8f6-d7bd-494e-9618-e2ca13dadfc6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.968999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.969115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.969180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.969354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.969558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.969661] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.969758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.969817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.969979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.970122] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.970212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.970310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.970397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.970471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.970547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.970698] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.970783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.970838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.971062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.971130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.971271] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.971358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.971413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.971579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.971711] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.971796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.971851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.971979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.972092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.972170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.972251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.975395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.975516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.975559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.975714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.977325] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e71d03b6-2bab-4f24-a6ee-b9da8e938815: rpc.has_security_group_logging(os_id): False [ 785.979094] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.979194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.980591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8041be8d-e946-4047-8d48-0e5c8a8422c0: rpc.has_security_group_logging(os_id): False [ 785.982036] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.982155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.982236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.982402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.982481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.982631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.982732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.982791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.982932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.983069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.983159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.983220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.983358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.983438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.983519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.983666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.983761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.983818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.983951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.984060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.984233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.984290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.984340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.984452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.984582] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.984671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.984729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.984892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.984934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.985003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.985087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.986548] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5054886e-af25-43c4-9482-725da5a36a84: rpc.has_security_group_logging(os_id): False [ 785.991975] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.992104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.992754] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dccfe94-a28c-458f-a44d-bf0826c447a8: rpc.has_security_group_logging(os_id): False [ 786.016280] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.016487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.028501] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.028686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.030488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.030620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.031274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.031387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.031457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.031690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.031787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.031887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aab864d-34fe-4cd4-9552-550bb898f42d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.044687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.045030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.045129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.045262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.045486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.045577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.045722] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be updated. [ 786.046911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.047103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.047193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.047318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.047469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.047654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.050870] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.050870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.058853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.059058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.096863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.097189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.097490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.097627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.097858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.097948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.098050] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be updated. [ 786.099325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.099498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.168054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.168344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.168478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.168611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.168866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.168988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.169181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.169290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.169354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.169514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.169594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.169801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.169916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.169966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.170083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.170160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.170260] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be updated. [ 786.171429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.171602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.224343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.224507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.256393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.256736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.256828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.256902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.257112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.257200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.257298] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be updated. [ 786.258548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.258738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.287407] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.287536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.312995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.313307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.313438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.313503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.313768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.313893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.314111] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.314213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.314274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.314445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.314519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.314786] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.314786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.314888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.315250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.315318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.315406] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be updated. [ 786.316663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.316818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.316906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.317025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.317153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.317295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.317434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.318520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.318744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.367480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: IN_PROGRESS for 2s [ 786.382890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.383173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.383300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.383370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.383578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.383664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.383856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.383955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.384037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.384190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.384266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.384457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.384535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.384596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.384739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.384819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.384899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be updated. [ 786.386195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.386370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.386519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.410518] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.410518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.410734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.410818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.410960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.426817] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: IN_PROGRESS for 2s [ 786.456853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: IN_PROGRESS for 2s [ 786.463684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.463881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.463979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.464249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.464436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.494643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.494790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.494859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.495070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.495320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.526034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.526235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.526312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.526602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.526765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.536521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: IN_PROGRESS for 2s [ 786.537755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: IN_PROGRESS for 2s [ 786.586152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: IN_PROGRESS for 2s [ 788.383025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: SUCCESS [ 788.383025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 788.439322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: SUCCESS [ 788.439322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 788.468554] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: SUCCESS [ 788.468554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 788.551279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: SUCCESS [ 788.551688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 788.552555] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: SUCCESS [ 788.552818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 788.596219] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: SUCCESS [ 788.596580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 790.746048] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 790.746348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 795.746942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 795.746942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 800.748285] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 800.748653] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 805.749273] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 805.749583] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 810.750080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 810.750080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 815.752226] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 815.752226] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 815.869849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-41ba88d0-cc22-4deb-b6a6-69c9a3167c8f req-cd0437a8-adfe-4996-aa1d-33c2e8294e77 tempest-InstanceActionsV221TestJSON-973339105 tempest-InstanceActionsV221TestJSON-973339105-project-member] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 815.869849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 815.869849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.892418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 815.894367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 815.894367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 815.894367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 815.894367] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 already deleted. [ 815.894367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.518088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.518281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.518409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.518720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.518894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.519124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-205 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.519283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-205" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.519400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-205" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.519674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-205" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.519940] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.520135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.520257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.520480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.520625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.520775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-205" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.521026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.521182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.521329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.521501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.521672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.521919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.522069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.522245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.522469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.522578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb09ac96-41a8-4e20-99f3-3ef6d8c9f872',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.542964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.543225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.543303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.543568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.543744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.543880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 not found, creating... [ 816.544161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.544331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.544453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.544679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.544849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.545140] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.545295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.545411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.545758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.545849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.545960] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 is going to be created. [ 816.569654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.569772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.569942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.570675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.570675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.570675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.969221] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-41ba88d0-cc22-4deb-b6a6-69c9a3167c8f req-69e2e35d-3bdd-43e5-ae74-f9982def2e7d service neutron] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_rules [ 816.969490] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-41ba88d0-cc22-4deb-b6a6-69c9a3167c8f req-69e2e35d-3bdd-43e5-ae74-f9982def2e7d service neutron] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 816.969490] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-41ba88d0-cc22-4deb-b6a6-69c9a3167c8f req-69e2e35d-3bdd-43e5-ae74-f9982def2e7d service neutron] Enqueued Resource ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with Priority: HIGHEST for action port [ 816.970061] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_rules [ 816.970195] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 816.970290] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with Priority: HIGHEST for action port [ 816.970571] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.970837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.970837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.970972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.971030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.971183] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.971277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.971339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.971875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.971875] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.972459] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.972575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.972642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.972815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.972896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.973042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.973135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.973196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.973338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.973475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.973881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.973881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.973881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.973881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.974091] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.974919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.975032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.975101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.975427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.975427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.975510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.975572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.975610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.975756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.975827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb09ac96-41a8-4e20-99f3-3ef6d8c9f872',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.992402] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.010605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.023253] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.023253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.023253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.023485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.023485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.023630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.023721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.026307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.026423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.026489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.026675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.026759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.026852] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be created. [ 817.035458] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with status ACTIVE [ 817.035756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.035880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.035945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.036168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.036255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.036425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.036519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.036578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.036716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.036790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.056840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.057026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.057068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.057263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.057661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.067931] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: UNINITIALIZED for 2s [ 817.538522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.538716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.538803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.539039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.539128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.539239] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 is going to be updated. [ 817.560824] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.560934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 817.560934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 817.561172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 817.561332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 817.561513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 818.523889] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b48bca80-bcab-49e4-88ba-97320a31b4f8 None None] Enqueued Resource ID: 79fc21a1-802d-4863-bf58-55090aea6a8b with Priority: HIGHEST for action port [ 818.524164] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fc21a1-802d-4863-bf58-55090aea6a8b with Priority: HIGHEST for action port [ 818.524731] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.524863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 818.524933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 818.525145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 818.525231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 818.525388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fc21a1-802d-4863-bf58-55090aea6a8b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.525487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fc21a1-802d-4863-bf58-55090aea6a8b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 818.525645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fc21a1-802d-4863-bf58-55090aea6a8b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 818.525767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fc21a1-802d-4863-bf58-55090aea6a8b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 818.525849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fc21a1-802d-4863-bf58-55090aea6a8b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.565927] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79fc21a1-802d-4863-bf58-55090aea6a8b [ 818.566708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.566918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 818.567052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 818.567332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 818.567471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 818.567617] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79fc21a1-802d-4863-bf58-55090aea6a8b already deleted. [ 818.567774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fc21a1-802d-4863-bf58-55090aea6a8b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 818.884247] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-96e528c5-6092-4623-ac2c-d08dc2eb6214 None None] Enqueued Resource ID: f0f65ed0-3020-462a-92ae-37cfa7d6682c with Priority: HIGHEST for action port [ 818.884485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f65ed0-3020-462a-92ae-37cfa7d6682c with Priority: HIGHEST for action port [ 818.885043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.885168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 818.885238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 818.885438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 818.885524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 818.885680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0f65ed0-3020-462a-92ae-37cfa7d6682c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.885778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0f65ed0-3020-462a-92ae-37cfa7d6682c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 818.885840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0f65ed0-3020-462a-92ae-37cfa7d6682c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 818.886034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0f65ed0-3020-462a-92ae-37cfa7d6682c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 818.886115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0f65ed0-3020-462a-92ae-37cfa7d6682c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.074613] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0f65ed0-3020-462a-92ae-37cfa7d6682c [ 819.074827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.074958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.075025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.075395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.075395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.075395] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0f65ed0-3020-462a-92ae-37cfa7d6682c already deleted. [ 819.075540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0f65ed0-3020-462a-92ae-37cfa7d6682c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.079100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 819.079300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.079453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.079652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.079836] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.079977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.080069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.080229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.080312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.080399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.080489] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.120960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.121537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.135652] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c221fa9-d7c5-4f9e-a059-1a11c92487e0: rpc.has_security_group_logging(os_id): False [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.157649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.158258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.158258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be created. [ 819.214317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.214511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.214550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.214740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.215116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.229319] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: IN_PROGRESS for 2s [ 821.243680] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 821.243969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.270841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d523649c-a85f-44f5-b0f1-452ced547ea4 None None] Enqueued Resource ID: 34e93e72-1ad3-4a1a-83f3-f643fdd04d7a with Priority: HIGHEST for action port [ 821.270989] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e93e72-1ad3-4a1a-83f3-f643fdd04d7a with Priority: HIGHEST for action port [ 821.271564] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.271688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.271757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.271958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.272061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.272217] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-34e93e72-1ad3-4a1a-83f3-f643fdd04d7a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.272315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34e93e72-1ad3-4a1a-83f3-f643fdd04d7a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.272376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34e93e72-1ad3-4a1a-83f3-f643fdd04d7a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.272604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34e93e72-1ad3-4a1a-83f3-f643fdd04d7a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.272656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e93e72-1ad3-4a1a-83f3-f643fdd04d7a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.466772] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34e93e72-1ad3-4a1a-83f3-f643fdd04d7a [ 821.467006] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.467100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.467163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.467365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.467453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.467606] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34e93e72-1ad3-4a1a-83f3-f643fdd04d7a already deleted. [ 821.467665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34e93e72-1ad3-4a1a-83f3-f643fdd04d7a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.958556] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1b0ebc79-75bf-4585-b41e-860859dfb3dd None None] Enqueued Resource ID: 063bc0a8-6e8a-4e20-ba86-46638878f09a with Priority: HIGHEST for action port [ 821.958823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063bc0a8-6e8a-4e20-ba86-46638878f09a with Priority: HIGHEST for action port [ 821.959396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.959517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.959582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.959765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.959848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.960047] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-063bc0a8-6e8a-4e20-ba86-46638878f09a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.960146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063bc0a8-6e8a-4e20-ba86-46638878f09a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.960206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063bc0a8-6e8a-4e20-ba86-46638878f09a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.960399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063bc0a8-6e8a-4e20-ba86-46638878f09a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.960475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063bc0a8-6e8a-4e20-ba86-46638878f09a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.974883] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 063bc0a8-6e8a-4e20-ba86-46638878f09a [ 821.975129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.975262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.975331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.975620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.975712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.975770] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:063bc0a8-6e8a-4e20-ba86-46638878f09a already deleted. [ 821.975847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063bc0a8-6e8a-4e20-ba86-46638878f09a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.959700] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 826.960031] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 831.961209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 831.961511] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 836.962993] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 836.962993] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 837.420839] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-766239bc-96d9-4dca-b07f-ef95ca9d60c2 None None] Enqueued Resource ID: c7793abe-9b90-4019-b40f-bb514bfc5d0c with Priority: HIGHEST for action port [ 837.421090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7793abe-9b90-4019-b40f-bb514bfc5d0c with Priority: HIGHEST for action port [ 837.421684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.421891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.421891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.422079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.422164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 837.422332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7793abe-9b90-4019-b40f-bb514bfc5d0c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.422405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7793abe-9b90-4019-b40f-bb514bfc5d0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.422491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7793abe-9b90-4019-b40f-bb514bfc5d0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.422723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7793abe-9b90-4019-b40f-bb514bfc5d0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.422723] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7793abe-9b90-4019-b40f-bb514bfc5d0c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.445654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7793abe-9b90-4019-b40f-bb514bfc5d0c [ 837.445886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.446015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.446086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.446287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.446378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 837.446484] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7793abe-9b90-4019-b40f-bb514bfc5d0c already deleted. [ 837.446568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7793abe-9b90-4019-b40f-bb514bfc5d0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 837.554100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-807e8c43-9c0a-4261-99ef-46e3fd206c27 None None] Enqueued Resource ID: ecca666d-7c07-4f49-842d-6cf79bfcb0ad with Priority: HIGHEST for action port [ 837.554353] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecca666d-7c07-4f49-842d-6cf79bfcb0ad with Priority: HIGHEST for action port [ 837.554901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.555116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.555116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.555285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.555367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 837.555545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecca666d-7c07-4f49-842d-6cf79bfcb0ad taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.555651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecca666d-7c07-4f49-842d-6cf79bfcb0ad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.555717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecca666d-7c07-4f49-842d-6cf79bfcb0ad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.555912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecca666d-7c07-4f49-842d-6cf79bfcb0ad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.555994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecca666d-7c07-4f49-842d-6cf79bfcb0ad',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.589122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecca666d-7c07-4f49-842d-6cf79bfcb0ad [ 837.589371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.589465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 837.589529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 837.589784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 837.589873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 837.589970] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecca666d-7c07-4f49-842d-6cf79bfcb0ad already deleted. [ 837.590047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecca666d-7c07-4f49-842d-6cf79bfcb0ad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.526162] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-912ac176-d7e2-4768-8a3c-9fd3be2d1dd2 tempest-ServerActionsV293TestJSON-2076507366 tempest-ServerActionsV293TestJSON-2076507366-project-member] Enqueued Resource ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 with Priority: HIGHEST for action security_group_rules [ 838.526709] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 with Priority: HIGHEST for action security_group_rules [ 838.527029] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.527159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.527228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.527422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.527508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.527693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19e5d19c-9fa3-45cd-94a6-c8afae507689 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.527784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.527848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.528060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.528139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19e5d19c-9fa3-45cd-94a6-c8afae507689',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.570298] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 already deleted. [ 838.570298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.706244] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e5c4d8e6-dd10-4da3-8f70-9e810a959a9e tempest-ServerActionsV293TestJSON-2076507366 tempest-ServerActionsV293TestJSON-2076507366-project-member] Enqueued Resource ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 with Priority: HIGHEST for action security_group_rules [ 838.706244] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 with Priority: HIGHEST for action security_group_rules [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19e5d19c-9fa3-45cd-94a6-c8afae507689 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.706244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19e5d19c-9fa3-45cd-94a6-c8afae507689',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.739207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.739372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.739420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.739637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.739734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.739827] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19e5d19c-9fa3-45cd-94a6-c8afae507689 already deleted. [ 838.739912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19e5d19c-9fa3-45cd-94a6-c8afae507689" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 839.811837] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1fddd07c-13be-430c-af20-016ba2a6a8e2 None None] Enqueued Resource ID: 4f595fc9-3922-4243-88ad-25b6e6d81295 with Priority: HIGHEST for action port [ 839.811837] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f595fc9-3922-4243-88ad-25b6e6d81295 with Priority: HIGHEST for action port [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f595fc9-3922-4243-88ad-25b6e6d81295 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f595fc9-3922-4243-88ad-25b6e6d81295" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f595fc9-3922-4243-88ad-25b6e6d81295" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f595fc9-3922-4243-88ad-25b6e6d81295" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 839.811837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f595fc9-3922-4243-88ad-25b6e6d81295',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.847056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f595fc9-3922-4243-88ad-25b6e6d81295 [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 839.847056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f595fc9-3922-4243-88ad-25b6e6d81295 already deleted. [ 839.847056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f595fc9-3922-4243-88ad-25b6e6d81295" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.003065] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2b727827-218d-4235-926b-eaad826c3d8a None None] Enqueued Resource ID: 33e3a714-c017-41c1-9ef7-8a1a1622fd0c with Priority: HIGHEST for action port [ 840.003065] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e3a714-c017-41c1-9ef7-8a1a1622fd0c with Priority: HIGHEST for action port [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-33e3a714-c017-41c1-9ef7-8a1a1622fd0c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33e3a714-c017-41c1-9ef7-8a1a1622fd0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33e3a714-c017-41c1-9ef7-8a1a1622fd0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33e3a714-c017-41c1-9ef7-8a1a1622fd0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.003065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e3a714-c017-41c1-9ef7-8a1a1622fd0c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.047393] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33e3a714-c017-41c1-9ef7-8a1a1622fd0c [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.047393] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33e3a714-c017-41c1-9ef7-8a1a1622fd0c already deleted. [ 840.047393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33e3a714-c017-41c1-9ef7-8a1a1622fd0c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 845.001193] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 845.001471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 849.690348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-fd482fea-fb93-4512-8791-623bd11a9392 None None] Enqueued Resource ID: ff7b0aa6-fa4e-4944-b320-4d4389e164b8 with Priority: HIGHEST for action port [ 849.690762] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff7b0aa6-fa4e-4944-b320-4d4389e164b8 with Priority: HIGHEST for action port [ 849.691432] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.691432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.691432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.691629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.691693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 849.691901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff7b0aa6-fa4e-4944-b320-4d4389e164b8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.692692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff7b0aa6-fa4e-4944-b320-4d4389e164b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.692692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff7b0aa6-fa4e-4944-b320-4d4389e164b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.693579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff7b0aa6-fa4e-4944-b320-4d4389e164b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.693579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff7b0aa6-fa4e-4944-b320-4d4389e164b8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.710717] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff7b0aa6-fa4e-4944-b320-4d4389e164b8 [ 849.710961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.711085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.711141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.711347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.711443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 849.711615] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff7b0aa6-fa4e-4944-b320-4d4389e164b8 already deleted. [ 849.711615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff7b0aa6-fa4e-4944-b320-4d4389e164b8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.219359] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e50822ef-4908-450c-b3ca-7d416c44757f None None] Enqueued Resource ID: 43dde13c-772c-4ba1-bf6d-9c0cb9fafeac with Priority: HIGHEST for action port [ 852.219624] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43dde13c-772c-4ba1-bf6d-9c0cb9fafeac with Priority: HIGHEST for action port [ 852.220524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.220848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.220848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.220950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.220982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.221135] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-43dde13c-772c-4ba1-bf6d-9c0cb9fafeac taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.221220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43dde13c-772c-4ba1-bf6d-9c0cb9fafeac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.221281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43dde13c-772c-4ba1-bf6d-9c0cb9fafeac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.221471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43dde13c-772c-4ba1-bf6d-9c0cb9fafeac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.221545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43dde13c-772c-4ba1-bf6d-9c0cb9fafeac',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.252335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43dde13c-772c-4ba1-bf6d-9c0cb9fafeac [ 852.252545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.252675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.252747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.253104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.253104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.253189] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43dde13c-772c-4ba1-bf6d-9c0cb9fafeac already deleted. [ 852.253228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43dde13c-772c-4ba1-bf6d-9c0cb9fafeac" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.914052] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6d033352-1bc6-4998-ad43-77db35b9bce9 None None] Enqueued Resource ID: dc2d1dd3-40c8-4104-b87c-81cd77f230e5 with Priority: HIGHEST for action port [ 852.914052] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2d1dd3-40c8-4104-b87c-81cd77f230e5 with Priority: HIGHEST for action port [ 852.914284] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.914581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.914581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.914691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.914740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.914934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc2d1dd3-40c8-4104-b87c-81cd77f230e5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.915018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc2d1dd3-40c8-4104-b87c-81cd77f230e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.915070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc2d1dd3-40c8-4104-b87c-81cd77f230e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.915237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc2d1dd3-40c8-4104-b87c-81cd77f230e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.915317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc2d1dd3-40c8-4104-b87c-81cd77f230e5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.951077] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc2d1dd3-40c8-4104-b87c-81cd77f230e5 [ 852.951357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.951554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 852.951656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 852.952033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 852.952252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 852.952386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc2d1dd3-40c8-4104-b87c-81cd77f230e5 already deleted. [ 852.952510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc2d1dd3-40c8-4104-b87c-81cd77f230e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.559352] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-ff898811-ee57-44c9-a645-737054ce5b40 None None] Enqueued Resource ID: 263b9792-ba05-4220-b186-a40a89e2afad with Priority: HIGHEST for action port [ 853.559352] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263b9792-ba05-4220-b186-a40a89e2afad with Priority: HIGHEST for action port [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-263b9792-ba05-4220-b186-a40a89e2afad taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-263b9792-ba05-4220-b186-a40a89e2afad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-263b9792-ba05-4220-b186-a40a89e2afad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-263b9792-ba05-4220-b186-a40a89e2afad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.559352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('263b9792-ba05-4220-b186-a40a89e2afad',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.585198] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 263b9792-ba05-4220-b186-a40a89e2afad [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.585198] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:263b9792-ba05-4220-b186-a40a89e2afad already deleted. [ 853.585198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-263b9792-ba05-4220-b186-a40a89e2afad" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.869142] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-f0bb3294-6d74-4e7b-a968-926bc458ff43 tempest-ServersTestManualDisk-1323072622 tempest-ServersTestManualDisk-1323072622-project-member] Enqueued Resource ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d with Priority: HIGHEST for action security_group_rules [ 853.869702] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d with Priority: HIGHEST for action security_group_rules [ 853.870020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.870134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.870201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.870396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.870475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.870636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.870735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.870786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.870980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.871058] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6401d2a-5d0c-4ce6-a62a-edcaed64849d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.928067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.928228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.928296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.928505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.928592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.928690] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d already deleted. [ 853.928795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 854.010665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d2498c24-7980-4c9a-acaf-8571f4d738ee tempest-ServersTestManualDisk-1323072622 tempest-ServersTestManualDisk-1323072622-project-member] Enqueued Resource ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d with Priority: HIGHEST for action security_group_rules [ 854.011179] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d with Priority: HIGHEST for action security_group_rules [ 854.011833] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.011960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 854.012052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 854.012249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 854.012332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 854.012487] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.012580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 854.012642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 854.012781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 854.012857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6401d2a-5d0c-4ce6-a62a-edcaed64849d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 854.048485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6401d2a-5d0c-4ce6-a62a-edcaed64849d already deleted. [ 854.048485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6401d2a-5d0c-4ce6-a62a-edcaed64849d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 855.618869] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5f43a7f1-2b9c-4e4d-9249-1a61d9b29a5a None None] Enqueued Resource ID: 08fbdae5-b18f-48d2-86db-4c999976dd99 with Priority: HIGHEST for action port [ 855.619135] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08fbdae5-b18f-48d2-86db-4c999976dd99 with Priority: HIGHEST for action port [ 855.619768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.619891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 855.619955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 855.620186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 855.620258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 855.620402] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-08fbdae5-b18f-48d2-86db-4c999976dd99 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.620495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08fbdae5-b18f-48d2-86db-4c999976dd99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 855.620553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08fbdae5-b18f-48d2-86db-4c999976dd99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 855.620908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08fbdae5-b18f-48d2-86db-4c999976dd99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 855.620908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08fbdae5-b18f-48d2-86db-4c999976dd99',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.656673] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08fbdae5-b18f-48d2-86db-4c999976dd99 [ 855.656868] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.657005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 855.657061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 855.657282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 855.657382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 855.657473] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08fbdae5-b18f-48d2-86db-4c999976dd99 already deleted. [ 855.657551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08fbdae5-b18f-48d2-86db-4c999976dd99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.119294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-25d26208-e8ef-4bc6-82cf-2e83c434a39f None None] Enqueued Resource ID: 1517325e-3659-4924-9da2-117bd0e57a9b with Priority: HIGHEST for action port [ 856.119804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1517325e-3659-4924-9da2-117bd0e57a9b with Priority: HIGHEST for action port [ 856.120163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1517325e-3659-4924-9da2-117bd0e57a9b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1517325e-3659-4924-9da2-117bd0e57a9b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.120986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1517325e-3659-4924-9da2-117bd0e57a9b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.121276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1517325e-3659-4924-9da2-117bd0e57a9b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.121276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1517325e-3659-4924-9da2-117bd0e57a9b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.155173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1517325e-3659-4924-9da2-117bd0e57a9b [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.155173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1517325e-3659-4924-9da2-117bd0e57a9b already deleted. [ 856.155173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1517325e-3659-4924-9da2-117bd0e57a9b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 860.496306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bd5b249e-a41a-4ee7-8464-587a98c7a087 None None] Enqueued Resource ID: 38622dad-173e-4a4e-902f-16a4d04ef7bb with Priority: HIGHEST for action port [ 860.496306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38622dad-173e-4a4e-902f-16a4d04ef7bb with Priority: HIGHEST for action port [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-38622dad-173e-4a4e-902f-16a4d04ef7bb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38622dad-173e-4a4e-902f-16a4d04ef7bb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38622dad-173e-4a4e-902f-16a4d04ef7bb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38622dad-173e-4a4e-902f-16a4d04ef7bb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 860.496306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38622dad-173e-4a4e-902f-16a4d04ef7bb',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.552320] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38622dad-173e-4a4e-902f-16a4d04ef7bb [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 860.552320] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38622dad-173e-4a4e-902f-16a4d04ef7bb already deleted. [ 860.552320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38622dad-173e-4a4e-902f-16a4d04ef7bb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 862.774364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8f1ae116-d642-47dc-98cd-4b21de40edba None None] Enqueued Resource ID: a1e9132f-126a-42cd-8996-963f5e5a4fe5 with Priority: HIGHEST for action port [ 862.774364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e9132f-126a-42cd-8996-963f5e5a4fe5 with Priority: HIGHEST for action port [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1e9132f-126a-42cd-8996-963f5e5a4fe5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1e9132f-126a-42cd-8996-963f5e5a4fe5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1e9132f-126a-42cd-8996-963f5e5a4fe5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1e9132f-126a-42cd-8996-963f5e5a4fe5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 862.774364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1e9132f-126a-42cd-8996-963f5e5a4fe5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.788235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1e9132f-126a-42cd-8996-963f5e5a4fe5 [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 862.788235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1e9132f-126a-42cd-8996-963f5e5a4fe5 already deleted. [ 862.788235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1e9132f-126a-42cd-8996-963f5e5a4fe5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 864.696205] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bd835634-f348-4848-a090-32f429465b58 tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 864.696748] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 864.696748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.696748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 864.697033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 864.697033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 864.697181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 864.697263] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.697403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 864.697403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 864.697511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 864.698986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3559f066-18f1-4ff2-8555-b55b7bf9d8a7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.717360] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.717523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 864.717604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 864.718128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 864.718128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 864.718128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.718385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 864.718385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 864.718498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 864.718498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 864.718609] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 already deleted. [ 864.718909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 865.094771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0a3f8bdc-1ec7-4006-8ba1-8f18f1ee79bd tempest-TaggedBootDevicesTest_v242-1001415429 tempest-TaggedBootDevicesTest_v242-1001415429-project-member] Enqueued Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 865.095324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 with Priority: HIGHEST for action security_group_members [ 865.095666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.095794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 865.095859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 865.096083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 865.096170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 865.096325] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.096422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 865.096486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 865.096637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 865.096792] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.096883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 865.096933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 865.097073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 865.097151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 865.097237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3559f066-18f1-4ff2-8555-b55b7bf9d8a7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.112358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.112522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 865.112598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 865.112803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 865.112900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 865.113088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.113197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 865.113248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 865.113459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 865.113459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 865.113586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3559f066-18f1-4ff2-8555-b55b7bf9d8a7 already deleted. [ 865.113627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3559f066-18f1-4ff2-8555-b55b7bf9d8a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 866.961250] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-89206dec-84e4-4512-8c60-a589ff599519 None None] Enqueued Resource ID: 7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f with Priority: HIGHEST for action port [ 866.961250] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f with Priority: HIGHEST for action port [ 866.961532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.961532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 866.961532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 866.961698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 866.961732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 866.961970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.961970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 866.962110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 866.962214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 866.962288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.013868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f [ 867.014052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.014188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 867.014270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 867.014455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 867.014542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 867.014636] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f already deleted. [ 867.014715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e34287b-ada3-4c4e-8c17-d2e33e0e1a1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 868.753840] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e0d35ab9-967b-4ddd-91fa-00b0d933b6ef None None] Enqueued Resource ID: 1c13ec6b-df62-4378-97cf-735714497573 with Priority: HIGHEST for action port [ 868.754444] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c13ec6b-df62-4378-97cf-735714497573 with Priority: HIGHEST for action port [ 868.754774] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.754903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 868.754996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 868.755217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 868.755304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 868.755465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c13ec6b-df62-4378-97cf-735714497573 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.755554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c13ec6b-df62-4378-97cf-735714497573" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 868.755658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c13ec6b-df62-4378-97cf-735714497573" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 868.755859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c13ec6b-df62-4378-97cf-735714497573" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 868.755935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c13ec6b-df62-4378-97cf-735714497573',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.766389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c13ec6b-df62-4378-97cf-735714497573 [ 868.766580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.766698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 868.766759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 868.766936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 868.767027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 868.767123] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c13ec6b-df62-4378-97cf-735714497573 already deleted. [ 868.767197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c13ec6b-df62-4378-97cf-735714497573" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 873.755695] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 873.756023] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 877.141010] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-cc8ed95f-b136-4f73-a2b4-a376a6923643 tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 877.141520] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 877.141807] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.141945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.142064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.142187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.142257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.142406] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-876ac07a-3706-46ba-8e12-fc057274e8fc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.142511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.142553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.143154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.143154] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.143154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.143154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.143154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.143381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.143381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876ac07a-3706-46ba-8e12-fc057274e8fc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.156590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.156730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.156786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.156977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.157064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.157242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.157333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.157393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.157533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.157637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.157710] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876ac07a-3706-46ba-8e12-fc057274e8fc already deleted. [ 877.157793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.552322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c285050f-18e2-4a9c-a3eb-1a78b531c7b8 tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 877.552322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-876ac07a-3706-46ba-8e12-fc057274e8fc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.552322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876ac07a-3706-46ba-8e12-fc057274e8fc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.560186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.560358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.560414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.560689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.560689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.560879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.560994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 877.561027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 877.561173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 877.561251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 877.561332] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876ac07a-3706-46ba-8e12-fc057274e8fc already deleted. [ 877.561405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.326724] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-47df1631-1ad8-4813-a71a-b33af2f37b99 tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 3a04e701-02e5-46b3-acdc-a925acd0162a with Priority: HIGHEST for action security_group_rules [ 878.327247] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a04e701-02e5-46b3-acdc-a925acd0162a with Priority: HIGHEST for action security_group_rules [ 878.327706] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.327818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.327818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a04e701-02e5-46b3-acdc-a925acd0162a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.328780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a04e701-02e5-46b3-acdc-a925acd0162a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.371543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.371639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.371712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.371927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.372043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.372126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a04e701-02e5-46b3-acdc-a925acd0162a already deleted. [ 878.372210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.497893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-3e14c502-c05c-4d63-b118-1419c576484a tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 3a04e701-02e5-46b3-acdc-a925acd0162a with Priority: HIGHEST for action security_group_rules [ 878.498411] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a04e701-02e5-46b3-acdc-a925acd0162a with Priority: HIGHEST for action security_group_rules [ 878.498752] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.498862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.498929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.499157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.499241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.499423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a04e701-02e5-46b3-acdc-a925acd0162a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.499527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.499584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.499774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.499851] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a04e701-02e5-46b3-acdc-a925acd0162a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.530268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.530414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 878.530488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 878.530692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 878.530784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 878.530877] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a04e701-02e5-46b3-acdc-a925acd0162a already deleted. [ 878.530958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a04e701-02e5-46b3-acdc-a925acd0162a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 883.499211] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 883.499469] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 888.500388] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 888.500646] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 893.501135] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 893.501463] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 898.502594] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 898.502954] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 903.504170] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 903.504416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 907.326098] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22dca4e6-6372-4c46-acaf-fc503ad7f5b0 req-893a13ff-cd93-4582-90a9-2c9756557fbc tempest-FloatingIPsAssociationNegativeTestJSON-743228547 tempest-FloatingIPsAssociationNegativeTestJSON-743228547-project-member] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 907.326621] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGHEST for action security_group_members [ 907.326936] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.327058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.327126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.327326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.327410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 907.327568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.327683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.327748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.327897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.328061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.328181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.328209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.328346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.328415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 907.328545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.339240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.339359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.339435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.339621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.339706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 907.339898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.339991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.340093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.340253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.340327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 907.340442] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be updated. [ 907.371754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.371950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 907.371950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 907.372176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 907.372319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 907.381783] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: IN_PROGRESS for 2s [ 908.815455] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4ec86499-99c2-4dee-ab4e-ba18e0090a83 req-a07153e0-a1ea-400c-83f3-f916c0b0f2c1 tempest-ServerRescueNegativeTestJSON-959391720 tempest-ServerRescueNegativeTestJSON-959391720-project-member] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 908.816118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 908.816446] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.816572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 908.816634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 908.816834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 908.817008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 908.817062] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.817145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 908.817277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 908.817387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 908.817516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.817639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 908.817716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 908.817843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 908.817922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 908.818008] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.842638] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.842839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 908.842839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 908.843040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 908.843137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 908.843410] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.843547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 908.843583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 908.843741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 908.843820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 908.843906] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 already deleted. [ 908.843986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.241698] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.241698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.241698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-510 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-510" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-510" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.243445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-510" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-510" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.246843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.247218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-158237e6-1cae-4463-a849-c7636a7e9502 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.247218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.247218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.247218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.247218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158237e6-1cae-4463-a849-c7636a7e9502',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.268997] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.269453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.269693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.270071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.270329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.270642] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 158237e6-1cae-4463-a849-c7636a7e9502 not found, creating... [ 909.271014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.271317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.271539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.271884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.272152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.272536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.272893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.273254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.273660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.274082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.274374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 158237e6-1cae-4463-a849-c7636a7e9502 is going to be created. [ 909.295725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.296182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.296510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.296927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.297326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.297767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.393787] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 in Status: SUCCESS [ 909.393982] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 deletion is rescheduled due to dependency. [ 909.394110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.647412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4ec86499-99c2-4dee-ab4e-ba18e0090a83 req-9fc2495b-142a-4136-80dd-46731444e06b service neutron] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_rules [ 909.647614] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4ec86499-99c2-4dee-ab4e-ba18e0090a83 req-9fc2495b-142a-4136-80dd-46731444e06b service neutron] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 909.647784] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4ec86499-99c2-4dee-ab4e-ba18e0090a83 req-9fc2495b-142a-4136-80dd-46731444e06b service neutron] Enqueued Resource ID: 158237e6-1cae-4463-a849-c7636a7e9502 with Priority: HIGHEST for action port [ 909.648030] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_rules [ 909.648167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 909.648266] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158237e6-1cae-4463-a849-c7636a7e9502 with Priority: HIGHEST for action port [ 909.648929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.649067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.649137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.649348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.649434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.649605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.649685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.649749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.649972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.650031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.655374] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.655505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.655581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.655791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.655878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.656060] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.656160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.656222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.656368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.656511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.656600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.656660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.656796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.656876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.656968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.657956] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.658074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.658122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.658276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.658373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.658573] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-158237e6-1cae-4463-a849-c7636a7e9502 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.658693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.658884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.658991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.659022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158237e6-1cae-4463-a849-c7636a7e9502',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.679489] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.681138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.681294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.681329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.681581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.681738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.681918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.682004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.688496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 158237e6-1cae-4463-a849-c7636a7e9502 with status ACTIVE [ 909.688681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.688819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.688889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.689089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.689177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.689350] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.689444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.689505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.689674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.689762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.691426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.701218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.701415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.701415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.701602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.701741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.701853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be created. [ 909.735901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.736249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 909.736412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 909.736731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 909.737012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 909.748392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: UNINITIALIZED for 2s [ 910.047359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.047781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 910.047781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 910.047885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 910.047981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 910.048238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 158237e6-1cae-4463-a849-c7636a7e9502 is going to be updated. [ 910.069221] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.069364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 910.069436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 910.069653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 910.069802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 910.069959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.759430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 911.759722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.759820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.760083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.760278] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.760403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.760470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.760623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.760709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.760834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.760880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.771536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.771799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.771799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.771934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.772027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.772194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.772289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.772350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.772493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.772640] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.772731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.772796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.772932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.773002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.773077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.773225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.773313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.773370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.773502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.773568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.773704] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.773790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.773845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.773974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.774133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.774261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.774326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.774463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.774536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.774615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.774699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.781768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c61b63d-18fa-4fbd-b651-ed6a9bd62170: rpc.has_security_group_logging(os_id): False [ 911.799378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.799599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.799709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.799998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.800145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.800429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.800492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.800603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.800826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.800896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.801142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.801544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.801651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.801874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.801920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.803008] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.803168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.803246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.803414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.803500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.803595] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be created. [ 911.862708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.862951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 911.863034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 911.863244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 911.863431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 911.875195] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: IN_PROGRESS for 2s [ 913.888322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 913.888622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 914.649421] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 914.649574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 917.769265] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a79277c7-4e6b-4e7d-be6b-c265ca8b81e5 None None] Enqueued Resource ID: d7cb8317-8afd-47b1-bd73-212b5d52be9c with Priority: HIGHEST for action port [ 917.769521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7cb8317-8afd-47b1-bd73-212b5d52be9c with Priority: HIGHEST for action port [ 917.770455] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.770455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 917.770455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 917.770455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 917.770650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 917.770681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7cb8317-8afd-47b1-bd73-212b5d52be9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.770766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7cb8317-8afd-47b1-bd73-212b5d52be9c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 917.770825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7cb8317-8afd-47b1-bd73-212b5d52be9c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 917.771010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7cb8317-8afd-47b1-bd73-212b5d52be9c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 917.771084] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7cb8317-8afd-47b1-bd73-212b5d52be9c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.781533] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7cb8317-8afd-47b1-bd73-212b5d52be9c [ 917.781900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.781900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 917.781900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 917.782070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 917.782160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 917.782224] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7cb8317-8afd-47b1-bd73-212b5d52be9c already deleted. [ 917.782297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7cb8317-8afd-47b1-bd73-212b5d52be9c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 919.753053] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2efbead3-763c-498f-96ca-fc7d7077cb4c None None] Enqueued Resource ID: 42af41c6-6c7e-4c51-8675-0fad0110d3b3 with Priority: HIGHEST for action port [ 919.753312] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42af41c6-6c7e-4c51-8675-0fad0110d3b3 with Priority: HIGHEST for action port [ 919.753885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.754149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 919.754149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 919.754247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 919.754327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 919.754470] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-42af41c6-6c7e-4c51-8675-0fad0110d3b3 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.754560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42af41c6-6c7e-4c51-8675-0fad0110d3b3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 919.755529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42af41c6-6c7e-4c51-8675-0fad0110d3b3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 919.755529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42af41c6-6c7e-4c51-8675-0fad0110d3b3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 919.755529] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42af41c6-6c7e-4c51-8675-0fad0110d3b3',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.780270] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42af41c6-6c7e-4c51-8675-0fad0110d3b3 [ 919.780467] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.780587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 919.780652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 919.780923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 919.780923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 919.781004] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42af41c6-6c7e-4c51-8675-0fad0110d3b3 already deleted. [ 919.781080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42af41c6-6c7e-4c51-8675-0fad0110d3b3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 924.754648] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.754950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 929.755570] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 929.755853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 934.757277] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 934.757571] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 939.758353] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 939.758627] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 944.760092] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 944.760428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 949.761357] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 949.761630] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 954.763082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 954.763338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 957.847259] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-9e2885f0-382c-444d-9c71-ff0848070f95 req-34997b9c-7396-41f5-8925-35c4c1967ac2 tempest-FloatingIPsAssociationTestJSON-830652871 tempest-FloatingIPsAssociationTestJSON-830652871-project-member] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 957.847792] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGHEST for action security_group_members [ 957.848161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.848265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.848336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.848525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.848864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 957.848864] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.848864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.849026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.849083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.849276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.849445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.849445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.849613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.849704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 957.849793] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.859937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.860173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.860349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.860436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 957.860611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.860759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.860892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.860965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 957.861047] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be updated. [ 957.891169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.892528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 957.892629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 957.892899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 957.893096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 957.903095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: IN_PROGRESS for 2s [ 959.916114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5054886e-af25-43c4-9482-725da5a36a84 in Status: SUCCESS [ 959.916358] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5054886e-af25-43c4-9482-725da5a36a84 deletion is rescheduled due to dependency. [ 959.916400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 962.848992] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 962.849309] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 964.276268] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2a3bf86d-bcb3-4b9b-91b5-f22a46b9a2a5 None None] Enqueued Resource ID: 7c870b0b-5bef-4d1c-bd74-017df426b4da with Priority: HIGHEST for action port [ 964.276559] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c870b0b-5bef-4d1c-bd74-017df426b4da with Priority: HIGHEST for action port [ 964.277121] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.277242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 964.277308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 964.277516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 964.277599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 964.277784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c870b0b-5bef-4d1c-bd74-017df426b4da taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.277888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c870b0b-5bef-4d1c-bd74-017df426b4da" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 964.278182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c870b0b-5bef-4d1c-bd74-017df426b4da" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 964.278182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c870b0b-5bef-4d1c-bd74-017df426b4da" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 964.278276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c870b0b-5bef-4d1c-bd74-017df426b4da',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.295473] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c870b0b-5bef-4d1c-bd74-017df426b4da [ 964.295473] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.295572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 964.295637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 964.295891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 964.295979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 964.296088] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c870b0b-5bef-4d1c-bd74-017df426b4da already deleted. [ 964.296168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c870b0b-5bef-4d1c-bd74-017df426b4da" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.648192] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a8abfe5e-fb24-4b93-84ed-2db74e9302a7 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 965.648655] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 965.649012] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.649135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.649204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.649399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.649483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.649635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.649729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.649791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.649985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.650065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.689744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.689905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.689972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.690213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.690304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.690399] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 already deleted. [ 965.690490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.731936] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-879e8149-1bc0-429c-b2f9-d689db263d62 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 965.732620] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 965.733521] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.733646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.733715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.733973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.734022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.734182] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.734289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.734467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.734528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.734600] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.772351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.772351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.772542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.772615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.772767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.772825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 already deleted. [ 965.772891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.919246] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c7a5d34c-2435-4650-9c9f-2dec6c7bb369 None None] Enqueued Resource ID: 669abb24-4187-42bb-8cf6-b1a80507acf3 with Priority: HIGHEST for action port [ 965.919516] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669abb24-4187-42bb-8cf6-b1a80507acf3 with Priority: HIGHEST for action port [ 965.920134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.920266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.920334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.920532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.920616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.920765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-669abb24-4187-42bb-8cf6-b1a80507acf3 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.920861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-669abb24-4187-42bb-8cf6-b1a80507acf3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.920923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-669abb24-4187-42bb-8cf6-b1a80507acf3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.921118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-669abb24-4187-42bb-8cf6-b1a80507acf3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.921197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669abb24-4187-42bb-8cf6-b1a80507acf3',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.931027] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 669abb24-4187-42bb-8cf6-b1a80507acf3 [ 965.931246] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.931378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 965.931447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 965.931647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 965.931737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 965.931826] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:669abb24-4187-42bb-8cf6-b1a80507acf3 already deleted. [ 965.931903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-669abb24-4187-42bb-8cf6-b1a80507acf3" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 969.319287] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c0238e73-af3e-4027-b787-04ee5277be54 None None] Enqueued Resource ID: 14d916cd-13eb-4577-be17-268666c4b500 with Priority: HIGHEST for action port [ 969.319287] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d916cd-13eb-4577-be17-268666c4b500 with Priority: HIGHEST for action port [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d916cd-13eb-4577-be17-268666c4b500 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d916cd-13eb-4577-be17-268666c4b500" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d916cd-13eb-4577-be17-268666c4b500" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d916cd-13eb-4577-be17-268666c4b500" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 969.319287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d916cd-13eb-4577-be17-268666c4b500',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.368133] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14d916cd-13eb-4577-be17-268666c4b500 [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 969.368133] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14d916cd-13eb-4577-be17-268666c4b500 already deleted. [ 969.368133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d916cd-13eb-4577-be17-268666c4b500" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 971.446700] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c696f36b-3cd6-4d1e-9aac-915b3f5425b3 None None] Enqueued Resource ID: 2ea84ee4-e016-4cee-8ed0-afe45221fb3a with Priority: HIGHEST for action port [ 971.447201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ea84ee4-e016-4cee-8ed0-afe45221fb3a with Priority: HIGHEST for action port [ 971.447513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.447683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 971.447752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 971.447949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 971.448045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 971.448203] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ea84ee4-e016-4cee-8ed0-afe45221fb3a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.448298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ea84ee4-e016-4cee-8ed0-afe45221fb3a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 971.448359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ea84ee4-e016-4cee-8ed0-afe45221fb3a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 971.448552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ea84ee4-e016-4cee-8ed0-afe45221fb3a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 971.448631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ea84ee4-e016-4cee-8ed0-afe45221fb3a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.460345] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ea84ee4-e016-4cee-8ed0-afe45221fb3a [ 971.460556] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.460668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 971.460752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 971.460961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 971.461057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 971.461159] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ea84ee4-e016-4cee-8ed0-afe45221fb3a already deleted. [ 971.461238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ea84ee4-e016-4cee-8ed0-afe45221fb3a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 976.449063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 976.449359] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 981.450634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 981.450887] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 986.452059] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 986.452316] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 989.824594] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 989.824862] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:2 started [ 991.453825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 991.454033] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 996.455622] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 996.455881] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 999.919790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8f205f99-84c4-4868-a890-01a1bd01cbd7 None None] Enqueued Resource ID: 5d75a189-ecbc-4e15-afc5-3ac66fe12ded with Priority: HIGHEST for action port [ 999.919790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d75a189-ecbc-4e15-afc5-3ac66fe12ded with Priority: HIGHEST for action port [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d75a189-ecbc-4e15-afc5-3ac66fe12ded taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d75a189-ecbc-4e15-afc5-3ac66fe12ded" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d75a189-ecbc-4e15-afc5-3ac66fe12ded" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d75a189-ecbc-4e15-afc5-3ac66fe12ded" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 999.919790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d75a189-ecbc-4e15-afc5-3ac66fe12ded',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.956100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d75a189-ecbc-4e15-afc5-3ac66fe12ded [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 999.956100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d75a189-ecbc-4e15-afc5-3ac66fe12ded already deleted. [ 999.956100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d75a189-ecbc-4e15-afc5-3ac66fe12ded" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.066537] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c1638193-a630-4f2d-b957-e9ff45f66b5e None None] Enqueued Resource ID: 24221a65-001f-4b55-b7be-e85d611bead9 with Priority: HIGHEST for action port [ 1002.066872] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24221a65-001f-4b55-b7be-e85d611bead9 with Priority: HIGHEST for action port [ 1002.067458] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.067577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.067690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.067927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.068020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.068180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-24221a65-001f-4b55-b7be-e85d611bead9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.068281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24221a65-001f-4b55-b7be-e85d611bead9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.068340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24221a65-001f-4b55-b7be-e85d611bead9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.073493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24221a65-001f-4b55-b7be-e85d611bead9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.073493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24221a65-001f-4b55-b7be-e85d611bead9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.097826] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24221a65-001f-4b55-b7be-e85d611bead9 [ 1002.098055] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.098190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.098274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.098463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.098553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.098645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24221a65-001f-4b55-b7be-e85d611bead9 already deleted. [ 1002.098722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24221a65-001f-4b55-b7be-e85d611bead9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.928845] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-9aa98ec7-60ad-4abf-835b-08d94080a5de None None] Enqueued Resource ID: 8ec8a8ca-e279-4268-b0d4-2cce7e768dd6 with Priority: HIGHEST for action port [ 1005.929365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec8a8ca-e279-4268-b0d4-2cce7e768dd6 with Priority: HIGHEST for action port [ 1005.929679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.929807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.929874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.930081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.930278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.930334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec8a8ca-e279-4268-b0d4-2cce7e768dd6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.930393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec8a8ca-e279-4268-b0d4-2cce7e768dd6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.930463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec8a8ca-e279-4268-b0d4-2cce7e768dd6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.930639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec8a8ca-e279-4268-b0d4-2cce7e768dd6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.930724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8a8ca-e279-4268-b0d4-2cce7e768dd6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.939589] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ec8a8ca-e279-4268-b0d4-2cce7e768dd6 [ 1005.939814] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.939973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.940056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.940252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.940479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.940479] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ec8a8ca-e279-4268-b0d4-2cce7e768dd6 already deleted. [ 1005.940580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec8a8ca-e279-4268-b0d4-2cce7e768dd6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1009.475096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-eddcfb2c-c199-4be9-94b6-d000a57326c4 None None] Enqueued Resource ID: bb0246eb-ff20-4f06-b82a-04a812e8e0ae with Priority: HIGHEST for action port [ 1009.475338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0246eb-ff20-4f06-b82a-04a812e8e0ae with Priority: HIGHEST for action port [ 1009.475929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.476063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.476125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.476319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.476397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1009.476573] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb0246eb-ff20-4f06-b82a-04a812e8e0ae taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.476647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb0246eb-ff20-4f06-b82a-04a812e8e0ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.476677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb0246eb-ff20-4f06-b82a-04a812e8e0ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.476912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb0246eb-ff20-4f06-b82a-04a812e8e0ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.476984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb0246eb-ff20-4f06-b82a-04a812e8e0ae',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.487231] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb0246eb-ff20-4f06-b82a-04a812e8e0ae [ 1009.487437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.487561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.487629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.487872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.487967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1009.488085] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb0246eb-ff20-4f06-b82a-04a812e8e0ae already deleted. [ 1009.488773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb0246eb-ff20-4f06-b82a-04a812e8e0ae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1010.033755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-bd971839-2607-4eb7-bf8a-30e4ca61d70e None None] Enqueued Resource ID: dcda25fe-ab65-48ee-b4ef-20ba626906fa with Priority: HIGHEST for action port [ 1010.034014] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcda25fe-ab65-48ee-b4ef-20ba626906fa with Priority: HIGHEST for action port [ 1010.034614] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.034771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1010.034811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1010.035002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1010.035085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1010.035238] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcda25fe-ab65-48ee-b4ef-20ba626906fa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.035336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcda25fe-ab65-48ee-b4ef-20ba626906fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1010.035438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcda25fe-ab65-48ee-b4ef-20ba626906fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1010.035604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcda25fe-ab65-48ee-b4ef-20ba626906fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1010.035685] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcda25fe-ab65-48ee-b4ef-20ba626906fa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.047866] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcda25fe-ab65-48ee-b4ef-20ba626906fa [ 1010.048699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.048699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1010.048699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1010.048699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1010.048699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1010.048699] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcda25fe-ab65-48ee-b4ef-20ba626906fa already deleted. [ 1010.053942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcda25fe-ab65-48ee-b4ef-20ba626906fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.033649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-5d5b745e-c16a-4ceb-bba3-bf54867e52ae tempest-ServerActionsTestOtherB-1030249969 tempest-ServerActionsTestOtherB-1030249969-project-member] Enqueued Resource ID: cff922a1-5f62-45c7-a38b-fa33645631fa with Priority: HIGHEST for action security_group_rules [ 1012.034331] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff922a1-5f62-45c7-a38b-fa33645631fa with Priority: HIGHEST for action security_group_rules [ 1012.034755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.034967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.035018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.035360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.035360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.035592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff922a1-5f62-45c7-a38b-fa33645631fa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.035699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.035797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.036185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.036185] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff922a1-5f62-45c7-a38b-fa33645631fa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.081382] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.081624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.081718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.082031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.082170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.082314] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff922a1-5f62-45c7-a38b-fa33645631fa already deleted. [ 1012.082438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.273675] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b1003500-fa1d-449a-876b-44957314dea5 tempest-ServerActionsTestOtherB-1030249969 tempest-ServerActionsTestOtherB-1030249969-project-member] Enqueued Resource ID: cff922a1-5f62-45c7-a38b-fa33645631fa with Priority: HIGHEST for action security_group_rules [ 1012.274063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff922a1-5f62-45c7-a38b-fa33645631fa with Priority: HIGHEST for action security_group_rules [ 1012.274428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.274546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.274617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.274807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.274891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.275037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff922a1-5f62-45c7-a38b-fa33645631fa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.275124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.275182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.275313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.275388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff922a1-5f62-45c7-a38b-fa33645631fa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.363693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.363831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.363908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.364174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.364275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.364372] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff922a1-5f62-45c7-a38b-fa33645631fa already deleted. [ 1012.364456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff922a1-5f62-45c7-a38b-fa33645631fa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.904550] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-37ea679d-acf4-4ef0-9dbb-162e6b456fa7 None None] Enqueued Resource ID: 72d1580f-a3ba-4183-9abf-3ef3edaefa1f with Priority: HIGHEST for action port [ 1012.904550] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72d1580f-a3ba-4183-9abf-3ef3edaefa1f with Priority: HIGHEST for action port [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-72d1580f-a3ba-4183-9abf-3ef3edaefa1f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72d1580f-a3ba-4183-9abf-3ef3edaefa1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72d1580f-a3ba-4183-9abf-3ef3edaefa1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72d1580f-a3ba-4183-9abf-3ef3edaefa1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.904550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d1580f-a3ba-4183-9abf-3ef3edaefa1f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.030258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72d1580f-a3ba-4183-9abf-3ef3edaefa1f [ 1013.030468] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.030653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1013.030689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1013.030911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1013.031012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1013.031108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72d1580f-a3ba-4183-9abf-3ef3edaefa1f already deleted. [ 1013.031184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72d1580f-a3ba-4183-9abf-3ef3edaefa1f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.641988] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-091db5c8-3151-4c36-adda-9d706dcf6d4b None None] Enqueued Resource ID: 5ea1680e-4c23-4b12-83de-5a216af68d24 with Priority: HIGHEST for action port [ 1014.641988] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea1680e-4c23-4b12-83de-5a216af68d24 with Priority: HIGHEST for action port [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ea1680e-4c23-4b12-83de-5a216af68d24 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ea1680e-4c23-4b12-83de-5a216af68d24" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ea1680e-4c23-4b12-83de-5a216af68d24" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ea1680e-4c23-4b12-83de-5a216af68d24" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.641988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea1680e-4c23-4b12-83de-5a216af68d24',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.694216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ea1680e-4c23-4b12-83de-5a216af68d24 [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.694216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ea1680e-4c23-4b12-83de-5a216af68d24 already deleted. [ 1014.694216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ea1680e-4c23-4b12-83de-5a216af68d24" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.139216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2dc34c31-b49d-4898-b4c3-0eb37e6b8861 None None] Enqueued Resource ID: 95f3e836-a780-421f-88f7-4d8274552755 with Priority: HIGHEST for action port [ 1015.139522] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95f3e836-a780-421f-88f7-4d8274552755 with Priority: HIGHEST for action port [ 1015.140084] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.140215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.140284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.140486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.140656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.140730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-95f3e836-a780-421f-88f7-4d8274552755 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.140826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95f3e836-a780-421f-88f7-4d8274552755" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.140887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95f3e836-a780-421f-88f7-4d8274552755" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.141081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95f3e836-a780-421f-88f7-4d8274552755" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.141159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95f3e836-a780-421f-88f7-4d8274552755',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.153549] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95f3e836-a780-421f-88f7-4d8274552755 [ 1015.153757] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.153884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.153954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.154162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.154253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.154740] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95f3e836-a780-421f-88f7-4d8274552755 already deleted. [ 1015.154740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95f3e836-a780-421f-88f7-4d8274552755" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.685635] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-fac6d501-e088-4296-bb76-b0827d31d75b None None] Enqueued Resource ID: 62b1ce82-7ffa-4f77-a81d-90baf5c99ccc with Priority: HIGHEST for action port [ 1015.686264] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b1ce82-7ffa-4f77-a81d-90baf5c99ccc with Priority: HIGHEST for action port [ 1015.686572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.686693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.686784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.686953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.687035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.687191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b1ce82-7ffa-4f77-a81d-90baf5c99ccc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.687299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b1ce82-7ffa-4f77-a81d-90baf5c99ccc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.687349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b1ce82-7ffa-4f77-a81d-90baf5c99ccc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.687528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b1ce82-7ffa-4f77-a81d-90baf5c99ccc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.687605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b1ce82-7ffa-4f77-a81d-90baf5c99ccc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.699734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62b1ce82-7ffa-4f77-a81d-90baf5c99ccc [ 1015.700027] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.700208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.700288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.700537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.700654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.700763] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62b1ce82-7ffa-4f77-a81d-90baf5c99ccc already deleted. [ 1015.700865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b1ce82-7ffa-4f77-a81d-90baf5c99ccc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.729933] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-78368a5e-912a-41fa-8827-4080ee5cdbd0 None None] Enqueued Resource ID: e9339b92-efbc-44a3-be45-55bb88fa6ed6 with Priority: HIGHEST for action port [ 1016.738021] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9339b92-efbc-44a3-be45-55bb88fa6ed6 with Priority: HIGHEST for action port [ 1016.738933] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-382e9de4-a8dc-4d40-a642-206118582704 None None] Enqueued Resource ID: 94879b0b-ad03-4090-a232-ad6ae635b0e6 with Priority: HIGHEST for action port [ 1016.739252] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.739385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.739448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.739637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.739763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.739928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9339b92-efbc-44a3-be45-55bb88fa6ed6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.740039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9339b92-efbc-44a3-be45-55bb88fa6ed6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.740077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9339b92-efbc-44a3-be45-55bb88fa6ed6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.740301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9339b92-efbc-44a3-be45-55bb88fa6ed6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.740441] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9339b92-efbc-44a3-be45-55bb88fa6ed6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.741532] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94879b0b-ad03-4090-a232-ad6ae635b0e6 with Priority: HIGHEST for action port [ 1016.742340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.742340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.742464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.742547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.742621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.742770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-94879b0b-ad03-4090-a232-ad6ae635b0e6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.742858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94879b0b-ad03-4090-a232-ad6ae635b0e6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.742917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94879b0b-ad03-4090-a232-ad6ae635b0e6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.743125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94879b0b-ad03-4090-a232-ad6ae635b0e6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.743200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94879b0b-ad03-4090-a232-ad6ae635b0e6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.764374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94879b0b-ad03-4090-a232-ad6ae635b0e6 [ 1016.764526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.764768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.764768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.764918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.765133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.765133] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94879b0b-ad03-4090-a232-ad6ae635b0e6 already deleted. [ 1016.765208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94879b0b-ad03-4090-a232-ad6ae635b0e6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.775183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9339b92-efbc-44a3-be45-55bb88fa6ed6 [ 1016.775362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.775487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.775555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.775759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.775848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.775985] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9339b92-efbc-44a3-be45-55bb88fa6ed6 already deleted. [ 1016.776024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9339b92-efbc-44a3-be45-55bb88fa6ed6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1018.590880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1e59f7cb-d72c-4df4-b5e6-89b88dc3c29f None None] Enqueued Resource ID: c6db9039-56e8-44c2-8138-abcf026c6ef5 with Priority: HIGHEST for action port [ 1018.590880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6db9039-56e8-44c2-8138-abcf026c6ef5 with Priority: HIGHEST for action port [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6db9039-56e8-44c2-8138-abcf026c6ef5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6db9039-56e8-44c2-8138-abcf026c6ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6db9039-56e8-44c2-8138-abcf026c6ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6db9039-56e8-44c2-8138-abcf026c6ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1018.590880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6db9039-56e8-44c2-8138-abcf026c6ef5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.599677] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6db9039-56e8-44c2-8138-abcf026c6ef5 [ 1018.599988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.600270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1018.600450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1018.600730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1018.600939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1018.601133] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6db9039-56e8-44c2-8138-abcf026c6ef5 already deleted. [ 1018.601499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6db9039-56e8-44c2-8138-abcf026c6ef5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1021.702966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.703342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1021.703342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1021.703417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1021.703491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1021.703681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.703782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1021.703845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1021.703989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1021.704133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.716443] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.726047] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.743243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1021.743243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1022.400903] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.401172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.401289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.401564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.414503] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1022.415027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.415754] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1022.453220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.453485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.453599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.453850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.467181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.468065] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1022.468224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1022.468355] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1022.497029] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.497029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.497029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.497029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.497029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.497029] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1022.530736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.530736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.530736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.530736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.530736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.530736] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1022.567273] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.567415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.567495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.567701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.567845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.568028] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 1022.568106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9c61b63d-18fa-4fbd-b651-ed6a9bd62170', 'fa91f3d7-2dd6-42f5-ad5c-5e8869447833', '5054886e-af25-43c4-9482-725da5a36a84', '8041be8d-e946-4047-8d48-0e5c8a8422c0', '4801f783-8dbc-45ec-a773-4c5f10604f95', '7c221fa9-d7c5-4f9e-a059-1a11c92487e0', '7dccfe94-a28c-458f-a44d-bf0826c447a8', 'e71d03b6-2bab-4f24-a6ee-b9da8e938815'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1022.568167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1022.605853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.606157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.606157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.606319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.606411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.606802] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1022.606802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1022.606802] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1022.643436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.643588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.643665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.643873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.644205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.644360] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1022.644435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1022.644504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1022.644572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1022.644645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 1022.644718] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1022.644796] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 1022.644862] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_rules [ 1022.644926] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_rules [ 1022.644989] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 1022.645075] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1022.645138] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 1022.645200] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 1022.645264] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1022.645325] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1022.645497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.645597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.645658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.645827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.645882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.646043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.646127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.646188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.646318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.646391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.646554] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.646642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.646702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.646837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.646903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.647063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.647163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.647216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.647321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.647388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.647545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.647645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.647703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.647803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.647864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.648038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.648145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.648213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.648297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.648364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.648525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.648612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.648658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.648783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.648847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.649005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.649095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.649154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.649283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.649354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.649512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.649599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.649656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.649782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.649854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.650144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.650235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.650295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.650435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.650507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.650664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.650767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.650836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.650970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.651061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.651227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.651310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.651364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.651512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.651581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.651741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.651823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.651878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.652028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.652094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.652250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.652333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.652388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.652512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.652580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.652736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.652812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.652870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.653001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.653093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.653261] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.653350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.653408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.653540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.653615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.653729] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1022.653802] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1022.653887] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1022.688684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.688891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.688891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.689085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.689285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.689430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1022.720248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.720661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1022.720661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1022.720661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1022.720775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1022.735232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1022.735232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.589900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1023.589900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=9], Jobs=0 [ 1023.589900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1023.589900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_rules [ 1023.589900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 1023.590799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_rules [ 1023.591080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.591248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.591352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.591592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.591711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.591894] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.591987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.592047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.592223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.592303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.593287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.593398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.593468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.593621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.593697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.593843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.593939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.594174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.594174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.594263] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.595028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.595312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.595312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.595379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.595410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.595538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.595626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.595698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.595816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.595885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.598822] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.599036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.599304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.599652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.599768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.600051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.600257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.600334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.600511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.600608] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.601802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.601802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.601802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.601960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.601994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.602203] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.602293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.602356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.602547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.602597] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.603340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.603457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.603555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.603720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.603818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.603968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.604110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.604172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.604312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.604405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.605338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.605471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.605545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.605757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.605814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.605958] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.606048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.606117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.606290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.606370] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.607547] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.607628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.607703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.607851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.607971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.608218] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.608311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.608311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.608425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.608483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.639987] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.640387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.640501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.640753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.640861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.641043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.641278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.641472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.641715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.641879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.641968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.642031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.642177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.642261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.642445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.642913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.646310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.646422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.646489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.646741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.646838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.647001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.647096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.647166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.647293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.647540] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.647631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.647712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.647947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.647947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.648088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.648120] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.650039] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.650155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.650258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.650403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.650479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.650659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.650757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.650819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.650957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.651104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.651531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.652031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.652031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.652031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.652031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.652210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.653686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.653801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.653963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.654344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.656095] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.656198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.656312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.656423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.656500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.656642] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.656735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.656798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.656943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.657082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.657164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.657223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.657367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.657446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.657637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.657764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.666674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.666810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.676852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.677003] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be deleted. [ 1023.678346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.678600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.681729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.681845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.681908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.682095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.682175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.682326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.682418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.682478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.682612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.682745] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.682830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.682887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.683016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.683089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.683165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.683305] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.683475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.683536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.683672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.683740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.683876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.683961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.684043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.684179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.684311] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.684395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.684449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.684574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.684925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.685014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.685099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.685924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.686026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.686090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.686311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.686388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.686530] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.686615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.686675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.686809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.686942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.687237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.687237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.687380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.687380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.687444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.687504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.689582] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.689682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.689743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.689892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.689965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.690104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.690190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.690365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.690510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.690645] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.690734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.690792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.690920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.690991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.691067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.691143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.691902] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.692096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.692217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.692345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.692427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.692575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.692706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.692835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.692978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.693105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.693177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.693253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.693393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.693477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.693533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.693658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.693726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.693855] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.693939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.693997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.694122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.694245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.694328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.694383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.694504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.694572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.694669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.694729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.695452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.695584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.695648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.695792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.695864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.696020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.696105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.696166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.696298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.696428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.696512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.696569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.696694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.696764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.696837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.696998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.697056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.697112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.697238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.697303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.697434] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.697516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.697572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.697728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.697862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.697945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.698000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.698177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.698220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.698264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.698338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.700329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.700551] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be deleted. [ 1023.702945] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.703641] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c61b63d-18fa-4fbd-b651-ed6a9bd62170: rpc.has_security_group_logging(os_id): False [ 1023.704557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.714836] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dccfe94-a28c-458f-a44d-bf0826c447a8: rpc.has_security_group_logging(os_id): False [ 1023.723600] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4801f783-8dbc-45ec-a773-4c5f10604f95: rpc.has_security_group_logging(os_id): False [ 1023.727275] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.728103] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c221fa9-d7c5-4f9e-a059-1a11c92487e0: rpc.has_security_group_logging(os_id): False [ 1023.729169] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e71d03b6-2bab-4f24-a6ee-b9da8e938815: rpc.has_security_group_logging(os_id): False [ 1023.733072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.733205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.733276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.733477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.737349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.737480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.738308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa91f3d7-2dd6-42f5-ad5c-5e8869447833: rpc.has_security_group_logging(os_id): False [ 1023.742992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.757483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.757625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.758977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.759137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.760167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.760328] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.760441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.760517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.760730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.760814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.761028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.761123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.761184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.761476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.761552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.761750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.761828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.761887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.762038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.762111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.762200] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be updated. [ 1023.763326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.763442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.763523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.763634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.763754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.763892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.765746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.765858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.771586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.771705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.774004] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.774120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.821673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.821985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.822233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.822322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.822537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.822626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.822833] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.822942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.823008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.823157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.823397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.823470] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.823524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.823558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.823679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.823768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.823899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be updated. [ 1023.825305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.825494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.859256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.859579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.859684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.859754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.860584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.860584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.860584] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be updated. [ 1023.862085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.862085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.893172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.893512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.893639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.893690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.893880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.893965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.894184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.894286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.894351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.894498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.894573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.894754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.894836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.894897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.895036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.895114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.895220] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be updated. [ 1023.896419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.896586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.905884] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.906020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.928089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.928228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.941370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.941698] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.941827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.941871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.942065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.942148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.942241] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be updated. [ 1023.943367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.943542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.943634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.943772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.943908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.944083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.974060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.975362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.975362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.975362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.975362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.975362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.975362] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be updated. [ 1023.976034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.976195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.976340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.977324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.977488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.977643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1023.979565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.979702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1023.979769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1023.979925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1023.980076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.011491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: IN_PROGRESS for 2s [ 1024.019394] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: IN_PROGRESS for 2s [ 1024.021547] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: IN_PROGRESS for 2s [ 1024.052930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.053073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.053171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.053348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.053497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.063817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.063988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.064152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.064299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.064459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.098752] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: IN_PROGRESS for 2s [ 1024.124206] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: IN_PROGRESS for 2s [ 1024.153066] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.153284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.153362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.153568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.153722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.174734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: IN_PROGRESS for 2s [ 1024.585023] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6061767f-6126-43f9-9c5d-132ca25e374a None None] Enqueued Resource ID: aa7e83d4-d32e-4b90-9a28-6b3095744467 with Priority: HIGHEST for action port [ 1024.585289] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7e83d4-d32e-4b90-9a28-6b3095744467 with Priority: HIGHEST for action port [ 1024.586037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.586104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.586143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.586356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.586639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.586639] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa7e83d4-d32e-4b90-9a28-6b3095744467 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.586760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa7e83d4-d32e-4b90-9a28-6b3095744467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.586760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa7e83d4-d32e-4b90-9a28-6b3095744467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.587775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa7e83d4-d32e-4b90-9a28-6b3095744467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.587775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa7e83d4-d32e-4b90-9a28-6b3095744467',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.629863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa7e83d4-d32e-4b90-9a28-6b3095744467 [ 1024.630112] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.630245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1024.630313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1024.630525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1024.630617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1024.630709] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa7e83d4-d32e-4b90-9a28-6b3095744467 already deleted. [ 1024.630791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa7e83d4-d32e-4b90-9a28-6b3095744467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.027868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 1026.028190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.031337] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: SUCCESS [ 1026.031595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.032428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: SUCCESS [ 1026.032651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.112107] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 1026.112107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.133846] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: SUCCESS [ 1026.134290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.186486] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: SUCCESS [ 1026.186710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.775477] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-cc4dc673-dcd8-40c6-aeed-f2e349d604c8 None None] Enqueued Resource ID: 1593a579-6853-432f-845e-57560c0efb86 with Priority: HIGHEST for action port [ 1026.775799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1593a579-6853-432f-845e-57560c0efb86 with Priority: HIGHEST for action port [ 1026.776418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.776546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1026.776621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1026.776817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1026.776954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.777116] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1593a579-6853-432f-845e-57560c0efb86 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.777221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1593a579-6853-432f-845e-57560c0efb86" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1026.777278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1593a579-6853-432f-845e-57560c0efb86" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1026.777492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1593a579-6853-432f-845e-57560c0efb86" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1026.777570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1593a579-6853-432f-845e-57560c0efb86',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.786954] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1593a579-6853-432f-845e-57560c0efb86 [ 1026.787144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.787259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1026.787326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1026.787506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1026.787597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1026.787838] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1593a579-6853-432f-845e-57560c0efb86 already deleted. [ 1026.787838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1593a579-6853-432f-845e-57560c0efb86" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1031.776735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1031.777047] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1036.778438] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1036.778438] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1040.173397] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-797f4ec7-4796-4eec-a047-d2c3a525580d None None] Enqueued Resource ID: 9d648720-a8c6-4135-b33c-b418bb91435f with Priority: HIGHEST for action port [ 1040.173753] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d648720-a8c6-4135-b33c-b418bb91435f with Priority: HIGHEST for action port [ 1040.174301] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1040.174404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1040.174585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1040.174711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1040.174832] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d648720-a8c6-4135-b33c-b418bb91435f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d648720-a8c6-4135-b33c-b418bb91435f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1040.175043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d648720-a8c6-4135-b33c-b418bb91435f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1040.175164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d648720-a8c6-4135-b33c-b418bb91435f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1040.175221] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d648720-a8c6-4135-b33c-b418bb91435f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.187884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d648720-a8c6-4135-b33c-b418bb91435f [ 1040.188371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.188371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1040.188371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1040.188648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1040.188648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1040.188742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d648720-a8c6-4135-b33c-b418bb91435f already deleted. [ 1040.188788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d648720-a8c6-4135-b33c-b418bb91435f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1045.174392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1045.174779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1045.690937] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-10b54f55-385a-4c32-b906-c755494bdaa9 None None] Enqueued Resource ID: d22cdb35-ee77-400f-a9bf-30a98969d84a with Priority: HIGHEST for action port [ 1045.691182] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22cdb35-ee77-400f-a9bf-30a98969d84a with Priority: HIGHEST for action port [ 1045.691749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.691878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1045.691935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d22cdb35-ee77-400f-a9bf-30a98969d84a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d22cdb35-ee77-400f-a9bf-30a98969d84a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d22cdb35-ee77-400f-a9bf-30a98969d84a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d22cdb35-ee77-400f-a9bf-30a98969d84a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1045.692772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d22cdb35-ee77-400f-a9bf-30a98969d84a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.702481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d22cdb35-ee77-400f-a9bf-30a98969d84a [ 1045.702690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.702821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1045.702892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1045.703086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1045.703176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1045.703270] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d22cdb35-ee77-400f-a9bf-30a98969d84a already deleted. [ 1045.703351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d22cdb35-ee77-400f-a9bf-30a98969d84a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1050.692316] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.692618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1055.693786] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1055.693786] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1060.657160] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-3d95f8f4-42e1-4ee0-a842-46d0c2b7bbdb req-9e8f3b48-cdc0-477c-a513-e9f6ba254217 tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1060.657730] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1060.658121] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.658190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.658228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.658408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.658522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.658655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.658737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.658833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.658972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.659204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.659204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.659310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.659478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.659478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.659565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.670798] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.670922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.670994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.671185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.671274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.671456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.671556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.671618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.671760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.671838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.671921] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 already deleted. [ 1060.671996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.034908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.035169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.035307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.035591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.035742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.035999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-842 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.036166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.036285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.036554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.036794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.036946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.037062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.037263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.037442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.037599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.037908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.038068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.038192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.038430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.038563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.038813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-65676593-bb14-439e-87af-75e2950f606b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.038964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.039075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.039367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.039523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65676593-bb14-439e-87af-75e2950f606b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.054951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.055166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.055290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.055608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.055762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.055942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 65676593-bb14-439e-87af-75e2950f606b not found, creating... [ 1061.056226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.056386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.056530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.056866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.057090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.057392] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.057547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.057669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.057949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.058039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.058212] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 65676593-bb14-439e-87af-75e2950f606b is going to be created. [ 1061.079735] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.079923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.080062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.080328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.080566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.080794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-3d95f8f4-42e1-4ee0-a842-46d0c2b7bbdb req-d2ffc040-e48e-4fcb-950c-644a64c46f02 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-3d95f8f4-42e1-4ee0-a842-46d0c2b7bbdb req-d2ffc040-e48e-4fcb-950c-644a64c46f02 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-3d95f8f4-42e1-4ee0-a842-46d0c2b7bbdb req-d2ffc040-e48e-4fcb-950c-644a64c46f02 service neutron] Enqueued Resource ID: 65676593-bb14-439e-87af-75e2950f606b with Priority: HIGHEST for action port [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1061.340313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65676593-bb14-439e-87af-75e2950f606b with Priority: HIGHEST for action port [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.340313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.341211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-65676593-bb14-439e-87af-75e2950f606b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.345381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65676593-bb14-439e-87af-75e2950f606b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.356347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.363689] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.363927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.364206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.364340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.364474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.364690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.364826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.366244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.372897] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65676593-bb14-439e-87af-75e2950f606b with status ACTIVE [ 1061.373295] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.373721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.373843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.374086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.374229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.374455] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.374602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.374705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.374905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.375032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.377411] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.377411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.377411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.377606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.377722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.377848] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be created. [ 1061.422712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.425939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.426077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.426581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.426847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.438867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: UNINITIALIZED for 2s [ 1061.785435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.785759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.785759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.785935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.786030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.786139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65676593-bb14-439e-87af-75e2950f606b is going to be updated. [ 1061.807860] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.808047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.808092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.808398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.808555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.808788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65676593-bb14-439e-87af-75e2950f606b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.449416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1063.449716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.450679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.450679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.450679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.450679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.450978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.450978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.450978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.451079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.451109] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.460587] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.460737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.460775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.460974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.461061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.461223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.461312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.461389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.461518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.461688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.461784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.461846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.461976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.462056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.462135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.462282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.462367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.462427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.462557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.462624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.462760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.462905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.462905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.463024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.463155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.463240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.463300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.463426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.463500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.463578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.463662] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.471154] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1063.490089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.490274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.490321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.490502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.490595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.490801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.490895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.490957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.491100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.491179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.491363] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.491456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.491516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.491650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.491724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.491897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.491999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.492054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.492193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.492267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.492349] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be created. [ 1063.549683] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.549890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1063.550039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1063.550283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1063.550408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1063.561097] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1065.574662] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1065.574662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1066.337588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1066.337588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1071.338361] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1071.338641] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1076.339502] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1076.339744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1078.018163] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b5e50c94-908f-4ea8-9284-93718b82721a tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 1078.018680] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 1078.019015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.019136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.019203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.019391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.019478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.019628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-876ac07a-3706-46ba-8e12-fc057274e8fc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.019711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.019771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.019912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.020073] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.020169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.020247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.020369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.020445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.020535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876ac07a-3706-46ba-8e12-fc057274e8fc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.033858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.034020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.034066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.034246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.034334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.034517] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.034607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.034668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.034809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.034885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.034967] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876ac07a-3706-46ba-8e12-fc057274e8fc already deleted. [ 1078.035043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.347789] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-60ef835f-c296-4ce5-8de0-872a9fbe2d1f tempest-TaggedBootDevicesTest-1956918411 tempest-TaggedBootDevicesTest-1956918411-project-member] Enqueued Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 1078.348347] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876ac07a-3706-46ba-8e12-fc057274e8fc with Priority: HIGHEST for action security_group_members [ 1078.348703] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.348817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.348934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.349094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.349178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.349336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-876ac07a-3706-46ba-8e12-fc057274e8fc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.349422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.349483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.349639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.349785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.349879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.349939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.350073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.350151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.350238] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876ac07a-3706-46ba-8e12-fc057274e8fc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.360234] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.360394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.360467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.360674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.360786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.360970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.361073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.361133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.361283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.361364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.361448] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876ac07a-3706-46ba-8e12-fc057274e8fc already deleted. [ 1078.361529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876ac07a-3706-46ba-8e12-fc057274e8fc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1079.036800] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-61c19923-9b8e-4977-83b8-feaf601a6f61 None None] Enqueued Resource ID: 552ea01a-4feb-4779-8e2c-b4bba4afef92 with Priority: HIGHEST for action port [ 1079.037052] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552ea01a-4feb-4779-8e2c-b4bba4afef92 with Priority: HIGHEST for action port [ 1079.037613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.037780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1079.037830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1079.038010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1079.038094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1079.038235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-552ea01a-4feb-4779-8e2c-b4bba4afef92 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.038337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-552ea01a-4feb-4779-8e2c-b4bba4afef92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1079.038379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-552ea01a-4feb-4779-8e2c-b4bba4afef92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1079.038563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-552ea01a-4feb-4779-8e2c-b4bba4afef92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1079.038656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('552ea01a-4feb-4779-8e2c-b4bba4afef92',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.061936] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 552ea01a-4feb-4779-8e2c-b4bba4afef92 [ 1079.062160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.062563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1079.062563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1079.062563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1079.062693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1079.062725] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:552ea01a-4feb-4779-8e2c-b4bba4afef92 already deleted. [ 1079.062845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-552ea01a-4feb-4779-8e2c-b4bba4afef92" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.011779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8352c6fa-4758-4ebc-8679-0022be2df541 None None] Enqueued Resource ID: 83d272ed-2543-4e1e-b98c-69600fa1622c with Priority: HIGHEST for action port [ 1081.012058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d272ed-2543-4e1e-b98c-69600fa1622c with Priority: HIGHEST for action port [ 1081.012575] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.012698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.012764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.012957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.013038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.013181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-83d272ed-2543-4e1e-b98c-69600fa1622c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.013268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83d272ed-2543-4e1e-b98c-69600fa1622c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.013326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83d272ed-2543-4e1e-b98c-69600fa1622c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.013512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83d272ed-2543-4e1e-b98c-69600fa1622c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.013585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d272ed-2543-4e1e-b98c-69600fa1622c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.022689] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83d272ed-2543-4e1e-b98c-69600fa1622c [ 1081.022910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.023031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.023099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.023279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.023369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.023458] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83d272ed-2543-4e1e-b98c-69600fa1622c already deleted. [ 1081.023533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83d272ed-2543-4e1e-b98c-69600fa1622c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.013323] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1086.013323] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1091.014778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1091.015159] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1096.016063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1096.016335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1101.017789] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1101.017789] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1106.018975] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1106.019263] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1107.318823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-43a89827-b28c-4ce3-bd61-8c099b1bdbfc req-51df177c-c19c-4731-8403-f55ff8d3175e tempest-TaggedAttachmentsTest-1196056706 tempest-TaggedAttachmentsTest-1196056706-project-member] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 1107.319328] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGHEST for action security_group_members [ 1107.319630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.319752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.319820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.320018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.320114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1107.320267] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.320363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.320424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.320571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.320705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.320799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.320850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.320983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.321060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1107.321143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.335117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.335261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.335306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.335473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.335562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1107.335739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.335835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.335898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.336055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.336135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1107.336235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be updated. [ 1107.369933] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1107.370167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1107.370273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1107.370413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1107.381569] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: IN_PROGRESS for 2s [ 1108.668825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-63eb822a-63ac-4d21-a5f4-d61859f4792c req-c44290be-5662-43e4-9448-0730b1507c1a tempest-ImagesOneServerTestJSON-549668524 tempest-ImagesOneServerTestJSON-549668524-project-member] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1108.669342] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1108.669655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.669782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.669842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.670088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.670222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.670429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.670550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.670632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.670874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.671026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.671120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.671178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.671346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.671425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.671529] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.680847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.680975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.681040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.681229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.681313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.681490] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.681579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.681640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.681867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.681969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.682081] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede already deleted. [ 1108.682167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.988714] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.989052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.989211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.989498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.989650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.989918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-922 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.990086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-922" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.990207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-922" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.990496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-922" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.990860] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.991044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.991171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.991378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.991522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.991676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-922" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.991927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.992106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.992228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.992436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.992573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1108.992932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.993175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1108.993299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1108.993545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1108.993665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.007948] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.008140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.008277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.008565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.008661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.008832] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a not found, creating... [ 1109.009090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.009249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.009370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.009579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.009722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.010005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.010161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.010279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.010484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.010621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.010764] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a is going to be created. [ 1109.031967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.032259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.032337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.032651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.032929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.033257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-63eb822a-63ac-4d21-a5f4-d61859f4792c req-51cff90d-9f02-477e-87b6-088e3a0242e5 service neutron] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_rules [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-63eb822a-63ac-4d21-a5f4-d61859f4792c req-51cff90d-9f02-477e-87b6-088e3a0242e5 service neutron] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-63eb822a-63ac-4d21-a5f4-d61859f4792c req-51cff90d-9f02-477e-87b6-088e3a0242e5 service neutron] Enqueued Resource ID: e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a with Priority: HIGHEST for action port [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_rules [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1109.251779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a with Priority: HIGHEST for action port [ 1109.252447] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.252641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.252772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.253277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.253434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.253690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.253862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.253974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.254289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.254426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.257017] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.257158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.257230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.257394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.258051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.258051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.258051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.258051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.258051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.258530] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.258530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.258530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.258530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.258673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.258673] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.259417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.259529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.259598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.259745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.259826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.259970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.260084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.260140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.260280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.260365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.273155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.282855] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.283003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.283003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.283212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.283294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.283456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.283551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.284636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.293786] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.293907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.293971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.294182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.294267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.294360] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be created. [ 1109.297010] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a with status ACTIVE [ 1109.297179] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.297290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.297346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.297521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.297604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.297790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.297879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.297942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.298085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.298157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.339334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.339470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.339539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.339758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.339919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.357456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: UNINITIALIZED for 2s [ 1109.391411] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 in Status: SUCCESS [ 1109.391589] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 deletion is rescheduled due to dependency. [ 1109.391706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.698012] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.698461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.698461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.698461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.699044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.699044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a is going to be updated. [ 1109.726636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.726822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1109.726867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1109.727056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1109.727256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1109.727446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e491bfb9-f6d6-4a7b-ad8d-638ac1602a9a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.367803] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: SUCCESS [ 1111.368221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.368221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.368449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.368644] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.368827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.368827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.368989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.369074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.369214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.369268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.378017] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.378147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.378197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.378325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.378405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.378560] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.378654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.378738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.379031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.379123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.379198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.379290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.379472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.379582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.379699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.379887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.380029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.380131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.380307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.380412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.380591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.380720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.380812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.380985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.381160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.381283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.381370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.381570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.381684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.381799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.381919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.388752] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 105ab1e0-aa9d-412e-9840-c617dca8aede: rpc.has_security_group_logging(os_id): False [ 1111.427298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.427510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.427510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.427751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.427861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.428066] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.428179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.428244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.428398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.428477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.430274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.430274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be created. [ 1111.494326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.494611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1111.494611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1111.494898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1111.495158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1111.510755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: IN_PROGRESS for 2s [ 1113.524612] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: SUCCESS [ 1113.524893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1114.253114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1114.253444] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1119.254649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1119.254879] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1124.256045] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1124.256391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1129.256805] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1129.257043] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1134.258484] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1134.258743] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1139.260494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.260494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1144.261966] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1144.262355] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1149.262969] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1149.263157] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1154.264303] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1154.264303] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1157.333865] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-109b1bb2-63bb-4b9f-8b9c-4da5e56ac9a3 req-b17868cd-ac35-4cbf-ae69-19fbe45467a4 tempest-ServerActionsTestJSON-25147579 tempest-ServerActionsTestJSON-25147579-project-member] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 1157.334374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGHEST for action security_group_members [ 1157.334694] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.334820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.334890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.335081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.335164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1157.335316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.335409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.335471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.335693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.335876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.335977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.336056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.336199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.336277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1157.336368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.345348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.345484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.345528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.345734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.345838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1157.346019] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.346120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.346197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.346334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.346399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1157.346482] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be updated. [ 1157.377536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.377680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1157.377821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1157.378038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1157.378185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1157.388213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: IN_PROGRESS for 2s [ 1158.628094] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-aa648d57-d92f-4d9c-8df7-94ae0280e5b8 req-4921f6aa-56e3-4706-b47f-9cdd91012e3b tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1158.628346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1158.628613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.628771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1158.628818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1158.628982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1158.629065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1158.629216] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.629312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1158.629371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1158.629547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1158.629688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.629778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1158.629838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1158.629972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1158.630052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1158.630134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.640052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.640218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1158.640261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1158.640446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1158.640540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1158.640721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.640837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1158.640902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1158.641046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1158.641120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1158.641202] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 already deleted. [ 1158.641278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.113775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.113975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.114108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.114374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.114520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.114784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-467 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.114944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.115064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.115323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.115571] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.115743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.115852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.116066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.116210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.116359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.116611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.116765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.116883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.117083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.117217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.117452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-a27e1527-9130-49a5-be27-029291331c78 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.117605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.117732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.118004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.118145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27e1527-9130-49a5-be27-029291331c78',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.134334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.134547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.134678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.134953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.135109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.135268] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port a27e1527-9130-49a5-be27-029291331c78 not found, creating... [ 1159.135535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.135697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.135849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.136108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.136266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.136543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.136703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.136826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.137036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.137175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.137319] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: a27e1527-9130-49a5-be27-029291331c78 is going to be created. [ 1159.161822] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.162044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.162173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.162457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.162695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.162922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.399082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 in Status: SUCCESS [ 1159.399248] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 deletion is rescheduled due to dependency. [ 1159.399364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.506775] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-aa648d57-d92f-4d9c-8df7-94ae0280e5b8 req-77660031-94c4-4c6d-a4ff-1e4b3c8b16d1 service neutron] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 1159.506960] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-aa648d57-d92f-4d9c-8df7-94ae0280e5b8 req-77660031-94c4-4c6d-a4ff-1e4b3c8b16d1 service neutron] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1159.507105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-aa648d57-d92f-4d9c-8df7-94ae0280e5b8 req-77660031-94c4-4c6d-a4ff-1e4b3c8b16d1 service neutron] Enqueued Resource ID: a27e1527-9130-49a5-be27-029291331c78 with Priority: HIGHEST for action port [ 1159.507324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_rules [ 1159.507450] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1159.507543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a27e1527-9130-49a5-be27-029291331c78 with Priority: HIGHEST for action port [ 1159.508194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.508324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.508392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.508624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.508681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.508853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.508953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.509015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.509160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.509234] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.510061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.510161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.510226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.510375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.510452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.510592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.510681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.510741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.510878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.511035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.511135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.511135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.511272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.511348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.511430] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.512608] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.512716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.512786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.512933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.513011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.513152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a27e1527-9130-49a5-be27-029291331c78 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.513242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.513303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.513438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.513506] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27e1527-9130-49a5-be27-029291331c78',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.534831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a27e1527-9130-49a5-be27-029291331c78 with status ACTIVE [ 1159.535171] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.535392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.535501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.535785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.535934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.536227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.536376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.536447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.536614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.536696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.540651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.540771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.540840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.541011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.541092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.541245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.541320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.541479] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.550703] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.557640] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.557939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.558073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.558325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.558467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.558650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 is going to be created. [ 1159.962510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.962855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.962855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.962930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.963030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.963125] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a27e1527-9130-49a5-be27-029291331c78 is going to be updated. [ 1159.988175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.988395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1159.988395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1159.988625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1159.988904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1159.989095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a27e1527-9130-49a5-be27-029291331c78" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1160.393185] neutron-nsxv3-agent[62156]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/e99a9006-ba9f-4366-9e90-536f58fe86a5', 'data': {'id': 'e99a9006-ba9f-4366-9e90-536f58fe86a5', 'display_name': 'e99a9006-ba9f-4366-9e90-536f58fe86a5', 'path': '/infra/domains/default/groups/e99a9006-ba9f-4366-9e90-536f58fe86a5', 'expression': [{'value': 'security_group|e99a9006-ba9f-4366-9e90-536f58fe86a5', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.14']}], 'tags': [{'scope': 'age', 'tag': 1707210972}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1160.393370] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=62156) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1162.424654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.425090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1162.425090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1162.425090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1162.425215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1162.434416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: UNINITIALIZED for 2s [ 1163.000412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-8f6c0ac6-56ee-46fa-a9b2-5d4027599cde None None] Enqueued Resource ID: 8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346 with Priority: HIGHEST for action port [ 1163.000412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346 with Priority: HIGHEST for action port [ 1163.001257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.001257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.001386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.001493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.001575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1163.001732] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.001832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.001916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.002279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.002279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.012916] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346 [ 1163.013115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.013234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.013304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.013618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.013618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1163.013740] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346 already deleted. [ 1163.013740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc5dcdd-a6b2-47d5-a6e5-1d64bdb7e346" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1163.895317] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-dfdf1925-e5df-4430-9856-f02b4933ef8e req-76093934-727a-42fe-8c0e-562ba6f26141 tempest-SecurityGroupRulesNegativeTestJSON-350842534 tempest-SecurityGroupRulesNegativeTestJSON-350842534-project-member] Enqueued Resource ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 with Priority: HIGHEST for action security_group_rules [ 1163.895832] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 with Priority: HIGHEST for action security_group_rules [ 1163.896154] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.896280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.896351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.896534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.896617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1163.896767] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.896873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.896916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.897097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.897175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395d6fa9-d398-48ef-a9b5-9b5b468fde39',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.935964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.935964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1163.935964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1163.935964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1163.936176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1163.936176] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 already deleted. [ 1163.936243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.160190] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05089823-c43c-4221-a926-fd822c955b28 req-140fefe7-4579-4a3b-a51a-4f4b1a623076 tempest-SecurityGroupRulesNegativeTestJSON-350842534 tempest-SecurityGroupRulesNegativeTestJSON-350842534-project-member] Enqueued Resource ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 with Priority: HIGHEST for action security_group_rules [ 1164.160684] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 with Priority: HIGHEST for action security_group_rules [ 1164.161004] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.161120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.161185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.161381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.161460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.161635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.161765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.161857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.162048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.162124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395d6fa9-d398-48ef-a9b5-9b5b468fde39',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.202755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.202885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.202953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.203166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.203254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.203343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395d6fa9-d398-48ef-a9b5-9b5b468fde39 already deleted. [ 1164.203420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395d6fa9-d398-48ef-a9b5-9b5b468fde39" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.446029] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: SUCCESS [ 1164.446246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.446749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.446961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.447150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.447307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.447382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.447478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.447559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.447641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.447821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.475371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.498623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e99a9006-ba9f-4366-9e90-536f58fe86a5: rpc.has_security_group_logging(os_id): False [ 1164.516479] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.516688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.516688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.516901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.517006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.517283] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.517390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.517437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.517594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.517676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.517839] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 is going to be created. [ 1164.575026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.575198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.575252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.575463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.575737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.589247] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: IN_PROGRESS for 2s [ 1164.697860] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-215cf7fd-6e08-409b-b9c2-f4e4012bf55c None None] Enqueued Resource ID: e2a5c92c-6b32-4db4-ad77-0d8a940545e7 with Priority: HIGHEST for action port [ 1164.698576] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2a5c92c-6b32-4db4-ad77-0d8a940545e7 with Priority: HIGHEST for action port [ 1164.699024] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.699151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.699217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.699427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.699512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.699673] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2a5c92c-6b32-4db4-ad77-0d8a940545e7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.699774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2a5c92c-6b32-4db4-ad77-0d8a940545e7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.699840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2a5c92c-6b32-4db4-ad77-0d8a940545e7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.700065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2a5c92c-6b32-4db4-ad77-0d8a940545e7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.700156] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2a5c92c-6b32-4db4-ad77-0d8a940545e7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.715561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2a5c92c-6b32-4db4-ad77-0d8a940545e7 [ 1164.715838] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.715965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1164.716040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1164.716239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1164.716330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1164.716420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2a5c92c-6b32-4db4-ad77-0d8a940545e7 already deleted. [ 1164.716499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2a5c92c-6b32-4db4-ad77-0d8a940545e7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1166.602759] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: SUCCESS [ 1166.603038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1169.699697] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.699697] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.090610] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a3e20579-eb0e-4d54-84c1-38a55455df51 None None] Enqueued Resource ID: e8f280d1-940c-4558-91ac-192d90119b99 with Priority: HIGHEST for action port [ 1170.091171] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f280d1-940c-4558-91ac-192d90119b99 with Priority: HIGHEST for action port [ 1170.091564] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.091735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1170.091825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1170.092123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1170.092245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1170.092468] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8f280d1-940c-4558-91ac-192d90119b99 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.092609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8f280d1-940c-4558-91ac-192d90119b99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1170.092674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8f280d1-940c-4558-91ac-192d90119b99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1170.092942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8f280d1-940c-4558-91ac-192d90119b99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1170.093067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8f280d1-940c-4558-91ac-192d90119b99',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.113721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8f280d1-940c-4558-91ac-192d90119b99 [ 1170.114104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.114250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1170.114350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1170.114565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1170.114655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1170.114747] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8f280d1-940c-4558-91ac-192d90119b99 already deleted. [ 1170.114826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8f280d1-940c-4558-91ac-192d90119b99" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1172.177622] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2d6187d0-9f3f-4f6e-a497-3e4486d25d30 None None] Enqueued Resource ID: 12ac6984-bd75-4706-8aea-5f730f111e6b with Priority: HIGHEST for action port [ 1172.177939] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ac6984-bd75-4706-8aea-5f730f111e6b with Priority: HIGHEST for action port [ 1172.178415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.178541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1172.178612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1172.178798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1172.179012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1172.179062] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ac6984-bd75-4706-8aea-5f730f111e6b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.179129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ac6984-bd75-4706-8aea-5f730f111e6b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1172.179165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ac6984-bd75-4706-8aea-5f730f111e6b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1172.179357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ac6984-bd75-4706-8aea-5f730f111e6b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1172.179432] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ac6984-bd75-4706-8aea-5f730f111e6b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.188662] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12ac6984-bd75-4706-8aea-5f730f111e6b [ 1172.188850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.188969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1172.189035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1172.189212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1172.189303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1172.189391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12ac6984-bd75-4706-8aea-5f730f111e6b already deleted. [ 1172.189470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ac6984-bd75-4706-8aea-5f730f111e6b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1177.178825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.179293] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1182.180564] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.180564] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1187.181991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1187.182395] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1192.183053] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.183389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1197.184592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.184592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.188659] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-61e0dc3e-110f-4c4b-8f08-368e8114b962 None None] Enqueued Resource ID: 0442c32e-5404-4f0b-b75c-5c00214e3429 with Priority: HIGHEST for action port [ 1201.188942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0442c32e-5404-4f0b-b75c-5c00214e3429 with Priority: HIGHEST for action port [ 1201.189779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.189906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.189974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.190179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.190263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1201.190592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0442c32e-5404-4f0b-b75c-5c00214e3429 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.190592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0442c32e-5404-4f0b-b75c-5c00214e3429" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.190592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0442c32e-5404-4f0b-b75c-5c00214e3429" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.190775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0442c32e-5404-4f0b-b75c-5c00214e3429" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.190812] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0442c32e-5404-4f0b-b75c-5c00214e3429',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.202489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0442c32e-5404-4f0b-b75c-5c00214e3429 [ 1201.202744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.202914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.203007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.203222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.203337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1201.203450] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0442c32e-5404-4f0b-b75c-5c00214e3429 already deleted. [ 1201.203549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0442c32e-5404-4f0b-b75c-5c00214e3429" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1201.928396] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a1f875a0-f6b7-490c-8abf-e101d51222a3 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1201.928396] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.928396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.960034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.960185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1201.960185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1201.960353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1201.960442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1201.960596] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 already deleted. [ 1201.960676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1202.023579] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2d9de021-b576-4b2a-a017-36d93b6e1663 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1202.024124] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1202.024431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.024546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1202.024604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1202.024805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1202.024883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1202.025028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.025117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1202.025175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1202.025313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1202.025465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.061505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.061640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1202.061756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1202.061931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1202.062030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1202.062122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 already deleted. [ 1202.062201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1203.418326] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-147b66e1-5f2d-44b2-954d-33c5680267a7 None None] Enqueued Resource ID: 5eda71ff-6f67-43f3-81f1-d7a3bf9b893a with Priority: HIGHEST for action port [ 1203.418598] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eda71ff-6f67-43f3-81f1-d7a3bf9b893a with Priority: HIGHEST for action port [ 1203.419152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.419269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1203.419371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1203.419531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1203.419613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1203.419763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5eda71ff-6f67-43f3-81f1-d7a3bf9b893a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.419876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5eda71ff-6f67-43f3-81f1-d7a3bf9b893a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1203.419945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5eda71ff-6f67-43f3-81f1-d7a3bf9b893a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1203.420204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5eda71ff-6f67-43f3-81f1-d7a3bf9b893a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1203.420284] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5eda71ff-6f67-43f3-81f1-d7a3bf9b893a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.435851] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5eda71ff-6f67-43f3-81f1-d7a3bf9b893a [ 1203.436311] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.436311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1203.436311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1203.436498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1203.436536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1203.436590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5eda71ff-6f67-43f3-81f1-d7a3bf9b893a already deleted. [ 1203.436670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5eda71ff-6f67-43f3-81f1-d7a3bf9b893a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.449013] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b9ee6d24-9a40-47f1-b39f-8fc795e35ed1 req-ea96b9e1-63d0-4efb-9b0c-5a835cf9cacf tempest-ServersAdminTestJSON-1987698982 tempest-ServersAdminTestJSON-1987698982-project-member] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 1207.449597] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGHEST for action security_group_members [ 1207.449889] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.450004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.450081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.450264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.450355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.450496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.450588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.450635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.450775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.450907] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.450995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.451043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.451178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.451248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.451333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.463860] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.464010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.464110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.464342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.464428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.464615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.464708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.464782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.464907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.464982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.465063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be updated. [ 1207.498915] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.499076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1207.499126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1207.499377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1207.499519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1207.510580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: IN_PROGRESS for 2s [ 1208.850983] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-2db4f15f-fd0a-4a3b-80f9-d53229f51860 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1208.851522] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1208.851845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.851972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1208.852055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1208.852294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1208.852367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1208.852547] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.852651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1208.852715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1208.852905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1208.853075] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.857960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1208.857960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1208.857960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1208.857960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1208.857960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.873099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.873264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1208.873309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1208.873899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1208.874014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1208.874237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.874337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1208.874411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1208.874566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1208.874678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1208.874780] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 already deleted. [ 1208.874862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.199767] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-d75bd069-7e7f-410e-b406-22433bc585b0 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1209.200254] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1209.200564] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.200679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.200743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.200939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.201022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.201158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.201250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.201310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.201480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.201581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.201668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.201724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.201866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.201941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.202022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.211699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.211819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.211888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.212091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.212178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.212395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.212443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.212509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.212647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.212721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.212801] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 already deleted. [ 1209.212875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.524316] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 in Status: SUCCESS [ 1209.524536] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 deletion is rescheduled due to dependency. [ 1209.524709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.594209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-ecaaad4a-df2d-43d4-acbe-da7dee37bef5 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1209.594754] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1209.595074] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.595198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.595267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.595467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.595553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.595709] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.595808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.595874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.596041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.596182] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.596410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.596410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.596461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.596534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.596622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.606508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.606692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.606795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.607024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.607152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.607362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.607496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.607586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.607830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.607964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.608231] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 already deleted. [ 1209.608360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.929257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.929593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.929593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.929840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.929989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.930246] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-903 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.930405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.930525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.930880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.931063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.931229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.931352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.931565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.931707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.931978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.932150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.932272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.932482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.932622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.932769] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: Segment with ID: nsx-vlan-transportzone-903 is going to be created. [ 1209.973383] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.973596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.973729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.974007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.974229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.974460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.974742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.974908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.975032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.975255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.975395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1209.975643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-1aeb195c-f802-4345-8127-9f56fc1397e5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.975800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1209.975923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1209.976210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1209.976354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aeb195c-f802-4345-8127-9f56fc1397e5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.002508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.002720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.002846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.003130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.003285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.003445] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 1aeb195c-f802-4345-8127-9f56fc1397e5 not found, creating... [ 1210.003709] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.003869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.003994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.004239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.004381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.004667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.004829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.004950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.005161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.005303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.005447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 1aeb195c-f802-4345-8127-9f56fc1397e5 is going to be created. [ 1210.048572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.048840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.048970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.049255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.049487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.049714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.596888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-a58829b8-28ec-4753-8573-563d47d62f35 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1210.597090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-a58829b8-28ec-4753-8573-563d47d62f35 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1210.597235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-a58829b8-28ec-4753-8573-563d47d62f35 service neutron] Enqueued Resource ID: 1aeb195c-f802-4345-8127-9f56fc1397e5 with Priority: HIGHEST for action port [ 1210.597453] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1210.597580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1210.597677] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aeb195c-f802-4345-8127-9f56fc1397e5 with Priority: HIGHEST for action port [ 1210.598297] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.598441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.598513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.598685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.598878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.599059] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.599163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.599226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.599432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.599513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.602623] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.602732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.602848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.602963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.603048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.603189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.603285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.603347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.603494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.603819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.603819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.603819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.603950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.603978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.604104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.604942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.605053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.605121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.605268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.605344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.605484] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aeb195c-f802-4345-8127-9f56fc1397e5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.605581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.605642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.605781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.605936] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aeb195c-f802-4345-8127-9f56fc1397e5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.630590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.630904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.635515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.635821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.635938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.636193] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.636324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.636543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.638281] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1aeb195c-f802-4345-8127-9f56fc1397e5 with status ACTIVE [ 1210.638505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.638654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.638816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.639040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.639161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.639404] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.639535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.639622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.639794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.639897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.644985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.655314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.655517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.655618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.655893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.656051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.656174] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be created. [ 1210.718671] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1ae2a174-56cb-4198-a454-d47d6dadc0f8 None None] Enqueued Resource ID: 319a937b-ad37-418f-954b-fd1b62c72131 with Priority: HIGHEST for action port [ 1210.718964] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 319a937b-ad37-418f-954b-fd1b62c72131 with Priority: HIGHEST for action port [ 1210.719578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.719688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.719749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.719955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.720066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.720262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-319a937b-ad37-418f-954b-fd1b62c72131 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.720431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-319a937b-ad37-418f-954b-fd1b62c72131" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.720431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-319a937b-ad37-418f-954b-fd1b62c72131" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.720648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-319a937b-ad37-418f-954b-fd1b62c72131" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.720724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('319a937b-ad37-418f-954b-fd1b62c72131',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.733108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 319a937b-ad37-418f-954b-fd1b62c72131 [ 1210.733320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.733526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.733526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.733722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.733811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.733937] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:319a937b-ad37-418f-954b-fd1b62c72131 already deleted. [ 1210.734001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-319a937b-ad37-418f-954b-fd1b62c72131" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.902217] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.902426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.902555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.902820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.902972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.903229] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-656 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.903387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-656" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.903507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-656" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.903769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-656" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.904043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.904206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.904326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.904536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.904682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.904838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-656" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.905090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.905246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.905367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.905652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.905705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.905996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.906269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.906269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.907028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.907302] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.926960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.927195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.927305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.927586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.927729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.927909] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 not found, creating... [ 1210.928188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.928384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.928578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.928681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.928882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.929220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.929349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.929596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.929660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.929802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.929935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 is going to be created. [ 1210.955809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.956098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1210.956237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1210.956515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1210.956772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.957005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1210.989572] neutron-nsxv3-agent[62156]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'data': {'id': '7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'display_name': '7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'path': '/infra/domains/default/groups/7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'expression': [{'value': 'security_group|7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.9', '10.0.0.12', '10.0.0.22']}], 'tags': [{'scope': 'age', 'tag': 1707211023}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1210.989765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=62156) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1211.042453] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.042713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.042825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.043128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.043256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.043401] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1aeb195c-f802-4345-8127-9f56fc1397e5 is going to be updated. [ 1211.072485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.072639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.072676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.073051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.073157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.073323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aeb195c-f802-4345-8127-9f56fc1397e5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-1dfa624f-ea5b-4dac-872a-204338daad03 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-1dfa624f-ea5b-4dac-872a-204338daad03 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-1dfa624f-ea5b-4dac-872a-204338daad03 service neutron] Enqueued Resource ID: eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 with Priority: HIGHEST for action port [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1211.396524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 with Priority: HIGHEST for action port [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.396524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.397240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.397612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.397612] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.433964] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 with status ACTIVE [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.433964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.849143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.849143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.849143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.849143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.849143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.849143] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1 is going to be updated. [ 1211.875622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.875839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.875883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.876118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.876273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.876444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb5dbe91-8472-4bde-92e0-1d0b4b8fb0e1" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.974197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.974586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.974586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.974830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.975008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.975170] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-903 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.975347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.975469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.975762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.976052] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.976226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.976349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.976571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.976718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.976866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-903" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.977119] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.977274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.977394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.977601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.977766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.978047] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-35098085-927f-4513-9778-197227df8aea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.978211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.978316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.978583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.978721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35098085-927f-4513-9778-197227df8aea',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.995810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.996075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.996209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.996482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.996635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.996800] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 35098085-927f-4513-9778-197227df8aea not found, creating... [ 1211.997063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.997219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.997337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.997549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.997689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.998122] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.998328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1211.998399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1211.998608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1211.998758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1211.998974] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 35098085-927f-4513-9778-197227df8aea is going to be created. [ 1212.026372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.026558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.026687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.027093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.027341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.027575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.340069] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-0889fe4b-b1d4-4351-9398-2c8c513a452a service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1212.340231] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-0889fe4b-b1d4-4351-9398-2c8c513a452a service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1212.340384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-0889fe4b-b1d4-4351-9398-2c8c513a452a service neutron] Enqueued Resource ID: 35098085-927f-4513-9778-197227df8aea with Priority: HIGHEST for action port [ 1212.340948] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1212.341095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1212.341243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35098085-927f-4513-9778-197227df8aea with Priority: HIGHEST for action port [ 1212.341482] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.341607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.341675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.342001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.342001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.342107] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.342216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.342376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.342531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.342531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.342674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.342780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.342925] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.343006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.343244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.343306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.343357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.343478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.343549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.343684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-35098085-927f-4513-9778-197227df8aea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.343765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.343825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.344152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.344152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35098085-927f-4513-9778-197227df8aea',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.374157] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35098085-927f-4513-9778-197227df8aea with status ACTIVE [ 1212.374550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.374656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.374784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.375037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.375191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.375414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.375568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.375670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.375894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.376066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.708744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.708898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.708971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.709181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.709275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.709372] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35098085-927f-4513-9778-197227df8aea is going to be updated. [ 1212.730924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.731102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1212.731147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1212.731353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1212.731496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1212.731651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35098085-927f-4513-9778-197227df8aea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1213.019458] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.019458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1213.019458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1213.019458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1213.019458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1213.028551] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: UNINITIALIZED for 2s [ 1213.414107] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-cab13f2a-f0bb-4c49-a208-fffd3bc28d15 None None] Enqueued Resource ID: f4994e4a-ce83-470d-a9b0-8718aec0fde9 with Priority: HIGHEST for action port [ 1213.414639] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4994e4a-ce83-470d-a9b0-8718aec0fde9 with Priority: HIGHEST for action port [ 1213.414952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.415070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1213.415135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1213.415335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1213.415416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1213.415579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4994e4a-ce83-470d-a9b0-8718aec0fde9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.415692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4994e4a-ce83-470d-a9b0-8718aec0fde9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1213.415765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4994e4a-ce83-470d-a9b0-8718aec0fde9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1213.415965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4994e4a-ce83-470d-a9b0-8718aec0fde9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1213.416057] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4994e4a-ce83-470d-a9b0-8718aec0fde9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.442853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4994e4a-ce83-470d-a9b0-8718aec0fde9 [ 1213.443072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.443204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1213.443274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1213.443479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1213.443950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1213.443950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4994e4a-ce83-470d-a9b0-8718aec0fde9 already deleted. [ 1213.443950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4994e4a-ce83-470d-a9b0-8718aec0fde9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.045742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.045742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.047968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.047968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.047968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.058297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.068352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.084275] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.110288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.110696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.111105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.111450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.111673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.111898] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1215.149492] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.149645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1215.149714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1215.149947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1215.150103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1215.160272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1217.172695] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1217.172962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1217.173441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1217.173645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1217.173827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.173937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1217.173998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1217.174135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1217.174210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1217.174295] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.182219] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.190676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.197550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.197693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1217.197763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1217.197988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1217.198080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1217.198172] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1217.226242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.226405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1217.226452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1217.226654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1217.226801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1217.235577] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1218.420574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.420847] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1218.482084] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-e3c1e7c6-d873-4d95-867d-e6f8249ecd4e None None] Enqueued Resource ID: 645ce133-ccee-4e7a-b3bf-bdae856b6fbc with Priority: HIGHEST for action port [ 1218.482593] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645ce133-ccee-4e7a-b3bf-bdae856b6fbc with Priority: HIGHEST for action port [ 1218.482919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.483028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.483084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.483288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-645ce133-ccee-4e7a-b3bf-bdae856b6fbc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645ce133-ccee-4e7a-b3bf-bdae856b6fbc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645ce133-ccee-4e7a-b3bf-bdae856b6fbc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645ce133-ccee-4e7a-b3bf-bdae856b6fbc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.484041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645ce133-ccee-4e7a-b3bf-bdae856b6fbc',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.525218] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 645ce133-ccee-4e7a-b3bf-bdae856b6fbc [ 1218.525532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.525589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.525627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.525819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.525912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1218.526006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:645ce133-ccee-4e7a-b3bf-bdae856b6fbc already deleted. [ 1218.526240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645ce133-ccee-4e7a-b3bf-bdae856b6fbc" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.246484] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1219.246695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.246865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.247074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.247263] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.247379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.247443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.247816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.247816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.247816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.247964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.248082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.248152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.248276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.248347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.248500] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.248622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.248685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.248880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.249038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.249130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.249192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.249387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.249505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.249615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.249677] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.259560] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1219.277399] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.277579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.277812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.277886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.277978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.278191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.278290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.278352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.278536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.278643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.278910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.279040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.279100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.279255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.279348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.279518] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.279614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.279670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.279810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.279886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.279999] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be created. [ 1219.343700] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.343864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1219.344110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1219.344211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1219.344534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1219.356744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1220.520263] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-4bb5fe08-06b1-4040-a863-ab50cfc9680d None None] Enqueued Resource ID: f5375112-2251-46f2-8f8f-b43ac5a41385 with Priority: HIGHEST for action port [ 1220.520782] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5375112-2251-46f2-8f8f-b43ac5a41385 with Priority: HIGHEST for action port [ 1220.521115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.521238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.521302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.521504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.521584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1220.521733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5375112-2251-46f2-8f8f-b43ac5a41385 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.521826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5375112-2251-46f2-8f8f-b43ac5a41385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.521887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5375112-2251-46f2-8f8f-b43ac5a41385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.522078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5375112-2251-46f2-8f8f-b43ac5a41385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.522239] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5375112-2251-46f2-8f8f-b43ac5a41385',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.543491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5375112-2251-46f2-8f8f-b43ac5a41385 [ 1220.543602] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.543732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.543802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.544029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.544128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1220.544225] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5375112-2251-46f2-8f8f-b43ac5a41385 already deleted. [ 1220.544307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5375112-2251-46f2-8f8f-b43ac5a41385" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1220.779315] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a382d829-1225-429e-9a64-123f0e0252ac None None] Enqueued Resource ID: 421b09ef-35e2-4e3e-a255-b8e23b734f8a with Priority: HIGHEST for action port [ 1220.779568] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 421b09ef-35e2-4e3e-a255-b8e23b734f8a with Priority: HIGHEST for action port [ 1220.780443] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.780443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.780443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.780604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.780702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1220.780818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-421b09ef-35e2-4e3e-a255-b8e23b734f8a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.780950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-421b09ef-35e2-4e3e-a255-b8e23b734f8a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.781002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-421b09ef-35e2-4e3e-a255-b8e23b734f8a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.781169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-421b09ef-35e2-4e3e-a255-b8e23b734f8a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.781248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('421b09ef-35e2-4e3e-a255-b8e23b734f8a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.807636] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 421b09ef-35e2-4e3e-a255-b8e23b734f8a [ 1220.808357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.808357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1220.808357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1220.808357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1220.808357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1220.808605] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:421b09ef-35e2-4e3e-a255-b8e23b734f8a already deleted. [ 1220.808605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-421b09ef-35e2-4e3e-a255-b8e23b734f8a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.372584] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1221.372584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.372584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.372584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.372584] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.391597] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.391769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.391827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.392018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.392123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.392290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.392380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.392448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.392596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.392748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.392838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.392896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.393080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.393155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.393202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.393266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.402804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.402962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.403013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.403221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.403299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.403457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.403546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.403607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.403746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.403900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.403993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.404096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.404237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.404320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.404404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.404555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.404647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.404776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.404839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.404916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.405055] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.405144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.405315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.405352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.405476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.405553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.405610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.405781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.405853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.405934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.406021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.417328] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1221.437148] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.437305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.437380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.437604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.437703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.438119] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.438245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.438317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.438507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.438597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.438978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.439078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.439156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.439323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.439407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.439627] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.439712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.439780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.439931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.440024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.440107] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1221.502411] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.502603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1221.502709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1221.502995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1221.503216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1221.522512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1222.905485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1cf27453-a170-4c24-90f1-fd2487766e7a None None] Enqueued Resource ID: 8eb9876b-d922-460b-94d0-63e5723d3076 with Priority: HIGHEST for action port [ 1222.905485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb9876b-d922-460b-94d0-63e5723d3076 with Priority: HIGHEST for action port [ 1222.905951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.906076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1222.906171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1222.906341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1222.906422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1222.906568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eb9876b-d922-460b-94d0-63e5723d3076 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.906660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eb9876b-d922-460b-94d0-63e5723d3076" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1222.906719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eb9876b-d922-460b-94d0-63e5723d3076" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1222.906912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eb9876b-d922-460b-94d0-63e5723d3076" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1222.906988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb9876b-d922-460b-94d0-63e5723d3076',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.916758] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8eb9876b-d922-460b-94d0-63e5723d3076 [ 1222.916964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.917085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1222.917152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1222.917386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1222.917477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1222.917570] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8eb9876b-d922-460b-94d0-63e5723d3076 already deleted. [ 1222.917647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eb9876b-d922-460b-94d0-63e5723d3076" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.538332] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1223.538555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.538744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.539148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.539148] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.552405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.552633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.552633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.552835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.552926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.553099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.553203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.553269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.553421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.553569] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.553663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.553729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.553869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.553953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.554038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.554129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.562264] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.562373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.562450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.562621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.562705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.562858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.562991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.563039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.563161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.563307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.563403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.563469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.563610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.563693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.563962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.563962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.564111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.564157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.564304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.564382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.564616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.564616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.564699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.565840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.576508] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1223.593579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.593757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.593798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.594318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.594318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.594318] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.594482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.594482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.594621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.594702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.594887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.594984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.595049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.595275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.595368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.595570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.595667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.595734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.595902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.596081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.596181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1223.653997] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.654191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1223.654233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1223.654424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1223.654577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.667906] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1225.684358] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1225.684607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1227.906470] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.906837] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1229.825181] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1229.825462] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1232.907558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.907947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.909078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.909078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.909799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.909799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.910288] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.910562] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.911737] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.911989] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.390685] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-95286149-51de-4d02-8e5e-cdeb294ddae9 req-4facd3c2-ce1f-4d01-a671-b6fea2d80dac tempest-ServersTestFqdnHostnames-913108469 tempest-ServersTestFqdnHostnames-913108469-project-member] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 1257.391239] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGHEST for action security_group_members [ 1257.391523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.391647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.391716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.391911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.391997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1257.392167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.392265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.392344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.392541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.392693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.392790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.392852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.392989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.393069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1257.393157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.403444] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.403573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.403610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.403785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.404030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1257.404071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.404160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.404224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.404381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.404459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1257.404545] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be updated. [ 1257.436875] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.437014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1257.437082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1257.437312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1257.437429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1257.447877] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: IN_PROGRESS for 2s [ 1258.933804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4d0b058a-7f00-47df-adca-619951160aea req-96d84898-c033-49de-b3b9-e49475ec481a tempest-ServerRescueTestJSONUnderV235-997901436 tempest-ServerRescueTestJSONUnderV235-997901436-project-member] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1258.934374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1258.934679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.934854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.934928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.935177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.935587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.935587] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.935699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.935699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.935940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.936123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.936232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.936300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.936444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.936527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.936616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.951844] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.952024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.952108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.952371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.952473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.952713] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.952825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.952938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.953122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.953213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.953341] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 already deleted. [ 1258.953480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.414022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.414022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.414022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.414236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.414276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.414531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-291 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.414690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-291" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.414813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-291" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.415077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-291" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.415326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.415484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.415605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.415815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.415959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.416266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.416455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.416584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.416829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.417032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.417222] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: Segment with ID: nsx-vlan-transportzone-291 is going to be created. [ 1259.441204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.441504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.441698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.442066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.442394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.442610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-291" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.442992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.443209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.443380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.443723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.443923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.444381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-99ac5c7e-a89c-40cf-bc59-8dfad731560d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.444613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.444796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.445186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.445395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac5c7e-a89c-40cf-bc59-8dfad731560d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.458083] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 in Status: SUCCESS [ 1259.458297] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 deletion is rescheduled due to dependency. [ 1259.458424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.463743] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.463945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.464089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.464362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.464511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.464665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 99ac5c7e-a89c-40cf-bc59-8dfad731560d not found, creating... [ 1259.464926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.465086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.465209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.465425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.465563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.465897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.466067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.466187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.466405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.466532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.466672] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 99ac5c7e-a89c-40cf-bc59-8dfad731560d is going to be created. [ 1259.495604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.495853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.495998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.496290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.496530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.496747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.789063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4d0b058a-7f00-47df-adca-619951160aea req-1ce9036f-29f2-438e-88d9-decaa5655adb service neutron] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_rules [ 1259.789236] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4d0b058a-7f00-47df-adca-619951160aea req-1ce9036f-29f2-438e-88d9-decaa5655adb service neutron] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1259.789376] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4d0b058a-7f00-47df-adca-619951160aea req-1ce9036f-29f2-438e-88d9-decaa5655adb service neutron] Enqueued Resource ID: 99ac5c7e-a89c-40cf-bc59-8dfad731560d with Priority: HIGHEST for action port [ 1259.789872] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_rules [ 1259.790000] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1259.790105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ac5c7e-a89c-40cf-bc59-8dfad731560d with Priority: HIGHEST for action port [ 1259.790625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.790745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.790810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.791004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.791087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.791233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.791323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.791381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.791570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.791643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.792739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.792844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.792907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.793054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.793125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.793260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.793345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.793402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.793533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.793664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.793747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.793802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.793930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.794004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.794081] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.794809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.794917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.795002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.795083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.795153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.795289] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ac5c7e-a89c-40cf-bc59-8dfad731560d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.795373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.795432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.795565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.795679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac5c7e-a89c-40cf-bc59-8dfad731560d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.816092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.831534] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.831682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.831753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.832019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.832659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.832847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.832941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.833612] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ac5c7e-a89c-40cf-bc59-8dfad731560d with status ACTIVE [ 1259.833839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.833918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.833957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.834130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.834218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.834382] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.834477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.834539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.834684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.834763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.836537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.844899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.845088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.845131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.845337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.845433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.845535] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be created. [ 1259.890351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.890553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.890553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.890781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.890949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.901895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: UNINITIALIZED for 2s [ 1260.453768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.454034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1260.454034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1260.454200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1260.454304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1260.454365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ac5c7e-a89c-40cf-bc59-8dfad731560d is going to be updated. [ 1260.475327] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.475523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1260.475523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1260.475908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1260.476144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1260.476315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ac5c7e-a89c-40cf-bc59-8dfad731560d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.706970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.706970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.707416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.707416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.707416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.707547] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.707626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.707675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.707829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.707970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.715925] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.724128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.732470] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1261.732846] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1261.925200] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: SUCCESS [ 1261.925455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.925629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.925853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.926050] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.926170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.926236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.926387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.926472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.926558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.926650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.936290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.936451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.936500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.936675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.936761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.936955] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.937126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.937185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.937339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.937488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.937581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.937643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.937812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.937899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.938009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.938138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.938230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.938290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.938428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.938502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.938715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.938834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.938901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.939045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.939198] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.939309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.939378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.939533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.939611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.939692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.939782] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.946167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0033677-0a6e-4486-8a4a-fa6c2b550528: rpc.has_security_group_logging(os_id): False [ 1261.969460] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.969792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.969792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.969954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.970051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.970266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.970368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.970433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.970583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.970659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.970854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.970970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.971035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.971180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.971259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.971448] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.971540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1261.971600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1261.971737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1261.971818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1261.971900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be created. [ 1262.037296] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.037469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.037547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.037777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.037971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.050471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: IN_PROGRESS for 2s [ 1262.491555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.491555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.491555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.492040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.506693] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1262.507235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.508588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1262.557946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.557946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.557946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.558303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.572388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.573674] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1262.573828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1262.573968] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1262.609839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.610065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.610065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.610298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.610920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.611063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1262.650186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.650428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.650428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.650629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.650855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.651038] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1262.699465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.699705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.699705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.699885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.700187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.700275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:11. [ 1262.700317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'105ab1e0-aa9d-412e-9840-c617dca8aede', '9c61b63d-18fa-4fbd-b651-ed6a9bd62170', 'fa91f3d7-2dd6-42f5-ad5c-5e8869447833', 'e0033677-0a6e-4486-8a4a-fa6c2b550528', '7c221fa9-d7c5-4f9e-a059-1a11c92487e0', '4801f783-8dbc-45ec-a773-4c5f10604f95', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'e99a9006-ba9f-4366-9e90-536f58fe86a5', '7dccfe94-a28c-458f-a44d-bf0826c447a8', 'e71d03b6-2bab-4f24-a6ee-b9da8e938815'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1262.700388] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1262.719718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.720128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.720128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.720226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.720279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.720367] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1262.720440] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1262.720585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1262.761890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.762106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.762106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.762295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.762732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.762912] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1262.762998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1262.763067] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1262.763132] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1262.763205] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 11/11 resources of Type:Security Group Rules [ 1262.763274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_rules [ 1262.763353] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1262.763416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 1262.763474] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1262.763532] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1262.763590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 1262.763648] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1262.763706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1262.763771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_rules [ 1262.763831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 1262.763890] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 1262.763952] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1262.764024] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1262.764211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.764314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.764368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.764536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.764607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.764776] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.764861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.764918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.765050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.765116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.765273] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.765356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.765411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.765538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.765608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.765795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.765884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.765939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.766071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.766140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.766299] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.766375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.766433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.766558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.766626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.766790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.766876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.766945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.767120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.767193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.767357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.767441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.767497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.767623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.767691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.767885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.768022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.768072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.768192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.768261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.768423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.768506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.768554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.768685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.768753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.768918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.769021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.769058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.769176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.769244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.769401] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.769482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.769535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.769659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.769726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.769893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.769975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.770084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.770148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.770220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.770376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.770453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.770509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.770636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.770703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.770857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.770933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.770992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.771118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.771186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.771425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.771508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.771554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.771692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.771763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.771923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.772021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.772077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.772206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.772275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.772433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.772512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.772570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.772698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.772774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.772934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.773018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.773073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.773200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.773270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.773428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.773504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.773563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.773689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.773757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.773970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.774052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.774052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.774167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.774235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.774390] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.774470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.774524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.774648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.774716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.774873] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.774972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.775032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.775164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.775233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.775392] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.775475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.775529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.775657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.775724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.775893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.775975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1262.776044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1262.776173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1262.776242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1262.776342] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:8 [ 1262.776400] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 8 of least updated resources [ 1262.776480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_members [ 1262.776569] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_members [ 1262.776637] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 158237e6-1cae-4463-a849-c7636a7e9502 with Priority: HIGH for action port [ 1262.776701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGH for action security_group_members [ 1262.776764] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with Priority: HIGH for action port [ 1262.776860] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGH for action security_group_members [ 1262.776893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_members [ 1262.776945] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_members [ 1262.777033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.064777] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: SUCCESS [ 1264.065053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=19], Jobs=0 [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_rules [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_rules [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1264.792039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 with Priority: HIGH for action security_group_members [ 1264.792327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 with Priority: HIGH for action security_group_members [ 1264.792327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5054886e-af25-43c4-9482-725da5a36a84 with Priority: HIGH for action security_group_members [ 1264.792327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1158288-998a-4271-bc1a-cf68dc491870 with Priority: HIGH for action security_group_members [ 1264.792327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158237e6-1cae-4463-a849-c7636a7e9502 with Priority: HIGH for action port [ 1264.792452] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with Priority: HIGH for action port [ 1264.792499] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_members [ 1264.792586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_members [ 1264.792675] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_rules [ 1264.792761] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_rules [ 1264.792846] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_rules [ 1264.792928] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_rules [ 1264.793012] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1264.793090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1264.793171] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1264.793251] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1264.793588] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.793715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.793795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.794101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.794191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.794355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.794455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.794557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.794653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.794727] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.795684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.795795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.795838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.795983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.796069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.796207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.796286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.796346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.796474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.796540] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.797366] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.797466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.797528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.797670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.797740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.797905] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.797994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.798051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.798183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.798247] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.799292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.799405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.799470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.799615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.799687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.799826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.799911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.799968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.800224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.800279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.800369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.800426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.800558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.800632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.800709] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.801416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.801513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.801574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.801717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.801787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.801921] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8041be8d-e946-4047-8d48-0e5c8a8422c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.802002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.802060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.802190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.802315] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.802399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.802454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.802579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.802647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.802722] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8041be8d-e946-4047-8d48-0e5c8a8422c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.803401] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.803498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.803561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.803703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.803773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.803907] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-5054886e-af25-43c4-9482-725da5a36a84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.803990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.804061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.804193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.804319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.804404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.804571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.804789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.804877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.805061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5054886e-af25-43c4-9482-725da5a36a84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.805909] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.806040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.806107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.806262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.806335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.806481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1158288-998a-4271-bc1a-cf68dc491870 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.806569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.806628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.806777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.806889] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.807018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.807084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.807219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.807289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.807365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1158288-998a-4271-bc1a-cf68dc491870',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.810014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.810117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.810183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.810399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.810399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.810551] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-158237e6-1cae-4463-a849-c7636a7e9502 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.810640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.810700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.810836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.810906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158237e6-1cae-4463-a849-c7636a7e9502',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.811609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.811722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.811789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.811936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.812025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.812172] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.812264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.812326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.812462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.812532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb09ac96-41a8-4e20-99f3-3ef6d8c9f872',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.813224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.813357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.813389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.813536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.813641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.813746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.813837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.813897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.814032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.814165] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.814254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.814311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.814441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.814514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.814593] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.815265] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.815373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.815438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.815579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.815662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.815818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.815910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.815970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.816122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.816255] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.816344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.816403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.816533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.816607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.816686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.955213] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.955381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.955459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.955700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.955806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.955973] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.956088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.956190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.956301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.956380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.957522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.957637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.957702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.957887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.957961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.958103] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.958192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.958378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.958542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.958606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.960024] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.960158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.960229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.960375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.960448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.960585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.960672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.960729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.960861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.960926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.961929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.962054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.962119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.962266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.962338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.962478] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.962617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.962681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.962820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.962887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.963806] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.963905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.963967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.964125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.964197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.964336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.964521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.964578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.964855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.964922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.965898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.966000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.966063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.966250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.966324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.966462] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.966547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.966606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.966738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.966802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.967721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.967844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.967912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.968078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.968152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.968291] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.968379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.968571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.968712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.968780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.969714] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.969812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.969874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.970018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.970099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.970249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.970336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.970393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.970527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.970591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.975333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.975407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.975407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.975562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.975642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.975854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.975944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.976015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.976156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.976228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.976311] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1158288-998a-4271-bc1a-cf68dc491870 is going to be deleted. [ 1264.977393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.978309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.978410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.978471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.978758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.978831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.979002] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.979090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.979125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.979286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.979388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.979473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.979529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.979661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.979965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.979965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.979965] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.981106] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 158237e6-1cae-4463-a849-c7636a7e9502 with status ACTIVE [ 1264.981272] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.981366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.981548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.981713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.981791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.981967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.982397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.982559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.982721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.983251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.985308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.985408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.985470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.985716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.985923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.986093] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.986185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.986245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.986384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.986523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.986609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.986667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.986797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.986869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.986945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.987021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.989097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.989207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.989262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.989411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.989488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.989657] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.989746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.989804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.989938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.990010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.990102] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5054886e-af25-43c4-9482-725da5a36a84 is going to be deleted. [ 1264.991096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 with status ACTIVE [ 1264.991254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.991351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.991413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.991599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.991636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.991847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.991913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.991913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.992081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.992144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.993167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.993260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.993325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.993467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.993543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.993706] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.993804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.993878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.993997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.994069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.994147] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469 is going to be deleted. [ 1264.995003] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.995231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.995303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.995452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.995528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.995716] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.995823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1264.995878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1264.996027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1264.996101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1264.996183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8041be8d-e946-4047-8d48-0e5c8a8422c0 is going to be deleted. [ 1264.996983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.019803] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.019981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.020075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.020294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.020375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.020549] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.020643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.020849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.020849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.020978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.021068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.021126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.021256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.021333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.021412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.021494] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.027313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.036372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.036507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.036574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.036779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.036860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.037017] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.037109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.037169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.037311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.037446] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.037532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.037590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.037808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.037808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.037915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.038037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.038121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.038177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.038310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.038378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.038512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.038594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.038651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.038903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.039068] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.039198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.039260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.039397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.039484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.039808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.039808] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.046432] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.046509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.046596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.046783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.048833] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.048833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.048970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.049080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.049166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.049262] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be updated. [ 1265.057930] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1265.074306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.077306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.077460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.077499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.077707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.077804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.077983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.078079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.078140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.078288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.078423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.078509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.078566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.078697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.078795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.078852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.079011] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.079092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.079148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.079282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.079349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.079483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.079565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.079620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.079749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.079890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.079973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.080042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.080174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.080244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.080318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.080421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.081707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.081809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.081876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.082025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.082098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.082241] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.082326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.082386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.082523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.082655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.082740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.082797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.082927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.082999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.083076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.083220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.083304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.083362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.083491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.083560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.083694] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.083815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.083876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.084030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.084166] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.084252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.084309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.084437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.084505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.084582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.084663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.096353] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.096510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.096546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.096767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.096841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.097008] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.097102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.097163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.097515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.097643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.097743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.097829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.097980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.098058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.098139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.098245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.099907] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.100015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.100858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.100950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.101665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.101755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.102998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 105ab1e0-aa9d-412e-9840-c617dca8aede: rpc.has_security_group_logging(os_id): False [ 1265.104358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.104466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.104533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.104719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.104806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.104956] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.105040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.105924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.106026] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be deleted. [ 1265.107464] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.107552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.107616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.107806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.109528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.109635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.109692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.109889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.109983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.110139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.110229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.111983] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1265.113738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.113849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.113909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.114087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.114169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.114259] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be updated. [ 1265.115339] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.115432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.115502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.115676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.115772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.115927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.116034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.116096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.116239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.116380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.116471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.116531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.116665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.116742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.116823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.116906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.118480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.125697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.125853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.125921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.126125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.126206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.126371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.126463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.126523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.126659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.126801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.126885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.126941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.127074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.127149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.127227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.127372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.127484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.127584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.127677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.127748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.127921] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.128021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.128081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.128216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.128349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.128435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.128493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.128622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.128695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.128780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.128882] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.135146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e99a9006-ba9f-4366-9e90-536f58fe86a5: rpc.has_security_group_logging(os_id): False [ 1265.137538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.137682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.137744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.137965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.138060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.138159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8041be8d-e946-4047-8d48-0e5c8a8422c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.140162] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.140273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.140341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.140520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.140605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.140699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1158288-998a-4271-bc1a-cf68dc491870" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.141932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.142052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.142121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.142286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.142370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.142460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5054886e-af25-43c4-9482-725da5a36a84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.145467] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.145581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.145648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.145854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.146005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.147585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0033677-0a6e-4486-8a4a-fa6c2b550528: rpc.has_security_group_logging(os_id): False [ 1265.149122] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.149239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.149308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.149474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.149555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.149647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd8cb98-0d60-4a98-9e8b-b9ac2ae5b469" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.150398] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.150482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.165807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.165939] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be deleted. [ 1265.167001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.167214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.171914] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: IN_PROGRESS for 2s [ 1265.179980] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.180164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.181126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.181263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.192863] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.193024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.228178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.228358] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be deleted. [ 1265.230445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.230445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.240383] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.240634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.241450] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.241591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.241634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.241834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.241976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.271284] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: IN_PROGRESS for 2s [ 1265.276641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.276854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be deleted. [ 1265.278021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.278283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.292666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.292878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.313841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.314307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.314307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.314307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.314637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.314637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.314747] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.314846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.314907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.315042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.315233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.315233] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1265.316793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.316903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.354480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.354968] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be updated. [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.354968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.377020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.377261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.439328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.439764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.439972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.440127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.440494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.440655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.440923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.441089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.441198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.441411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.441542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.441780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.441935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.442039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.442234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.442364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.442502] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1265.444504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.444725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.444865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.445036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.445222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.445415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.445561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.445724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.445938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.446132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.502742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.503196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.503365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.503476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.503727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.503865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.504043] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 is going to be updated. [ 1265.505581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.505845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.604209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.604456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.621808] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.622061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.627426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.627850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.628070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.628190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.628469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.628612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.628954] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.629198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.629320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.629558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.629697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.630014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.630182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.630331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.630571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.630739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.630923] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be updated. [ 1265.632586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.632818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.632968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.633147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.633338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.633540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.633674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.633847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.634211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.634423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.634687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.636118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.636346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.636547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.663143] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1265.664670] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: IN_PROGRESS for 2s [ 1265.676288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.676537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.676658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.676932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.677191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.679143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.679324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.679439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.679665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.679859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.725059] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1265.756129] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: IN_PROGRESS for 2s [ 1265.806081] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1265.806081] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.806081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1265.806356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1265.806356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1265.806551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.850587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: IN_PROGRESS for 2s [ 1266.322306] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1266.322929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.323140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1266.323285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1266.323442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1266.323535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1266.323630] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb09ac96-41a8-4e20-99f3-3ef6d8c9f872 is going to be updated. [ 1266.365780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.366093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1266.366093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1266.366329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1266.366520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1266.366725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb09ac96-41a8-4e20-99f3-3ef6d8c9f872" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1266.370456] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1266.371080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.371222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1266.371285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1266.371508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1266.371625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1266.371725] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 158237e6-1cae-4463-a849-c7636a7e9502 is going to be updated. [ 1266.419952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.420198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1266.420238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1266.420455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1266.420603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1266.420770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-158237e6-1cae-4463-a849-c7636a7e9502" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.183788] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 1267.184062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.184253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.184473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.184663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.184810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.184884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.184998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.185081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.185177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.185271] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.195436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.195572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.195647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.195804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.195886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.196072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.196190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.196234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.196375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.196522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.196615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.196674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.196859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.196922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.197030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.197193] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.197286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.197351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.197489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.197561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.197700] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.197864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.197944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.198069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.198209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.198301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.198360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.198490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.198566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.198645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.198726] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.205384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c221fa9-d7c5-4f9e-a059-1a11c92487e0: rpc.has_security_group_logging(os_id): False [ 1267.224078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.224159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.224218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.224484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.243554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.244076] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.244345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.244505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.244784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.244963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.245274] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.245490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.245696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.246123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.246330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.246612] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.246830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.246984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.247213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.247384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.247553] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be updated. [ 1267.280705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 1267.281184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.281465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.281786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.282139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.282462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.282629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.283096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.283289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.283469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.283650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.293101] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.293451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.293658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.293951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.294150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.294427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.294680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.294863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.295127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.295394] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.295636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.295845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.296125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.296327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.296522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.296784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.297022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.297204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.297460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.297652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.297919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.298163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.298396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.298659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.298915] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.299143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.299316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.299570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.299761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.299951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.300174] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.306790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c61b63d-18fa-4fbd-b651-ed6a9bd62170: rpc.has_security_group_logging(os_id): False [ 1267.309813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.310117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.310320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.310610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.310884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.331932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: IN_PROGRESS for 2s [ 1267.341999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.342510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.342723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.343062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.364964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.365649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.366154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.366490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.366904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.367123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.367452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.367709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.368031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.368343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.368565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.368933] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.369196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.369368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.369633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.369833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.370030] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be updated. [ 1267.446681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.447253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1267.447440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1267.447822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1267.448115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.461474] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: IN_PROGRESS for 2s [ 1267.676960] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: SUCCESS [ 1267.677472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.678523] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1267.678941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.750236] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1267.750746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.768437] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: SUCCESS [ 1267.768859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1267.863309] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: SUCCESS [ 1267.863778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1269.351102] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 1269.351468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1269.473881] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 1269.474096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1269.794337] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.794547] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.795813] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.796173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.797352] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.797652] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.799073] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.799455] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1289.800727] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.801099] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.802190] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.802444] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.803274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.803274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.803914] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.804340] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.916071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-41ba88d0-cc22-4deb-b6a6-69c9a3167c8f req-974e1d0d-0789-47bf-985c-fa17d5423e71 tempest-InstanceActionsV221TestJSON-973339105 tempest-InstanceActionsV221TestJSON-973339105-project-member] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 1307.916071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGHEST for action security_group_members [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.916071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.917617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1307.917617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.929516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.929842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.930012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.930284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.930481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1307.930830] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.931026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.931181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.931409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.931571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1307.931735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be updated. [ 1307.977652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.978054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1307.978225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1307.978514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1307.978767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1307.994306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: IN_PROGRESS for 2s [ 1309.092035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-c35ff189-1d3d-4afe-b155-8cdebd0b35f8 req-cba2e180-6902-4275-b4bf-581c7bf85494 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1309.092035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1309.092035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.092035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.093181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.093785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.093785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.093785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.093785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.093785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.107165] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.107300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.107370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.108603] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 already deleted. [ 1309.108603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.847427] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05c4e0ec-ca24-40be-8a87-5d3d082b1b07 req-5a259da0-4b01-485b-b592-6bb1cfaf9661 tempest-ServerRescueTestJSON-780895511 tempest-ServerRescueTestJSON-780895511-project-member] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1309.848255] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1309.848529] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.848691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.848761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.849020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.849150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.849384] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.849536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.849625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.849936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.850225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.850352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.850787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.850787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.850787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.851050] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.870749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.870907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.871013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.871246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.871341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.871568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.871670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1309.871733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1309.871886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1309.871964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1309.872069] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 already deleted. [ 1309.872145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.002874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.004053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.004285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.004680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.004874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.005195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-733 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.005366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.005484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.005761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.006181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.006355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.006468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.006691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.006833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.006979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.007285] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.007440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.007565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.007764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.008088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.008354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-895e98c2-3051-483b-9a3e-c58652a5b46f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.008514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.008633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.008987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.009145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895e98c2-3051-483b-9a3e-c58652a5b46f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.010619] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 in Status: SUCCESS [ 1310.010772] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 deletion is rescheduled due to dependency. [ 1310.010867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.023813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.024048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.024189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.024457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.024613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.024765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 895e98c2-3051-483b-9a3e-c58652a5b46f not found, creating... [ 1310.025139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.025306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.025427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.025649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.025793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.026082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.026238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.026358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.026563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.026699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.026843] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 895e98c2-3051-483b-9a3e-c58652a5b46f is going to be created. [ 1310.049290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.050104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.050329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.050712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.050996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.051238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.395841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.396193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.396193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.396449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.396589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.396853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-438 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.397007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-438" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.397125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-438" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.397413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-438" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.397660] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.397915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.398136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.398436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.398588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.398745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-438" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.399037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.399196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.399315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.399522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.399656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.399893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-cf31e87a-32f9-480e-81ed-3c91152548dd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.400056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.400199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.400466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.400601] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf31e87a-32f9-480e-81ed-3c91152548dd',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.414994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.415206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.415394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.415654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.415869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.416046] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port cf31e87a-32f9-480e-81ed-3c91152548dd not found, creating... [ 1310.416305] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.416463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.416584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.416797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.416937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.417220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.417376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.417497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.417704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.417883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.418036] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: cf31e87a-32f9-480e-81ed-3c91152548dd is going to be created. [ 1310.442800] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.443037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.443170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.443440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.443674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.443899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.459568] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-c35ff189-1d3d-4afe-b155-8cdebd0b35f8 req-fbd41fcd-d70f-414b-aeb3-ce92c9eeceb2 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1310.459754] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-c35ff189-1d3d-4afe-b155-8cdebd0b35f8 req-fbd41fcd-d70f-414b-aeb3-ce92c9eeceb2 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1310.459897] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-c35ff189-1d3d-4afe-b155-8cdebd0b35f8 req-fbd41fcd-d70f-414b-aeb3-ce92c9eeceb2 service neutron] Enqueued Resource ID: 895e98c2-3051-483b-9a3e-c58652a5b46f with Priority: HIGHEST for action port [ 1310.460370] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1310.460505] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1310.460599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 895e98c2-3051-483b-9a3e-c58652a5b46f with Priority: HIGHEST for action port [ 1310.460878] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.460998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.461066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.461254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.461334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.461477] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.461570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.461631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.461820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.461913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.462699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.462808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.462875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.463024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.463101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.463243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.463335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.463395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.463529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.463663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.463751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.463811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.463944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.464041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.464125] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.464896] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.464972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.465008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.465138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.465216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.465360] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-895e98c2-3051-483b-9a3e-c58652a5b46f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.465452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.465514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.465758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.465858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895e98c2-3051-483b-9a3e-c58652a5b46f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.478489] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.483565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.483649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.483726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.483953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.484056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.484247] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.484333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.490182] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.493863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 895e98c2-3051-483b-9a3e-c58652a5b46f with status ACTIVE [ 1310.494056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.494172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.494240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.494434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.494520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.494696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.494795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.494858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.495053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.495491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.498073] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.498214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.498264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.498401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.498538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.498583] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be created. [ 1310.530032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.530311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.530398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.530632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.530803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.542985] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: UNINITIALIZED for 2s [ 1310.908722] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.908987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.908987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.909149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.909226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.909349] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 895e98c2-3051-483b-9a3e-c58652a5b46f is going to be updated. [ 1310.928847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.929009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1310.929093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1310.929272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1310.929411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1310.929567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-895e98c2-3051-483b-9a3e-c58652a5b46f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.011080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05c4e0ec-ca24-40be-8a87-5d3d082b1b07 req-3411f4b2-2fbc-486e-8bd7-f4cddbda5ca6 service neutron] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_rules [ 1311.011080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05c4e0ec-ca24-40be-8a87-5d3d082b1b07 req-3411f4b2-2fbc-486e-8bd7-f4cddbda5ca6 service neutron] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1311.011080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05c4e0ec-ca24-40be-8a87-5d3d082b1b07 req-3411f4b2-2fbc-486e-8bd7-f4cddbda5ca6 service neutron] Enqueued Resource ID: cf31e87a-32f9-480e-81ed-3c91152548dd with Priority: HIGHEST for action port [ 1311.011558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_rules [ 1311.011700] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1311.011805] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf31e87a-32f9-480e-81ed-3c91152548dd with Priority: HIGHEST for action port [ 1311.012110] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.012232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.012292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.012496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.012584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.012733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.012848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.012931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.013079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.013194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.014021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.014134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.014213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.014340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.014419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.014562] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.014655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.014712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.014852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.014993] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.015087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.015147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.016939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.017221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.017292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.018590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.019058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.019165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.019337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.019440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.019754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf31e87a-32f9-480e-81ed-3c91152548dd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.020467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.020467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.020467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.020467] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf31e87a-32f9-480e-81ed-3c91152548dd',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.035003] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.058511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.058511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.058511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.058511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.058511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.059016] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.059016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.059541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.061245] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf31e87a-32f9-480e-81ed-3c91152548dd with status ACTIVE [ 1311.061476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.061591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.061591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.061803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.061941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.062037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.062228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.062369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.062482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.062567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.068624] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.068848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.068848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.069064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.069158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.069257] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 is going to be created. [ 1311.138329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.138329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.138329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.138579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.139778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.151919] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: UNINITIALIZED for 2s [ 1311.448747] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.449071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.449071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.449199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.449302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.449402] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf31e87a-32f9-480e-81ed-3c91152548dd is going to be updated. [ 1311.469425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.469616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1311.469616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1311.469837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1311.469972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1311.470135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf31e87a-32f9-480e-81ed-3c91152548dd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.554192] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1312.554539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.554759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.555022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.555248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.555372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.555440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.555597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.555684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.555771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.555880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.568635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.569240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.576335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 1312.594976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.595163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.595163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.595273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.595443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.595558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.595655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.595738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.595910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.595982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.596231] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.596364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.596404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.596517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.596589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.596857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.597022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.597022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.597122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.597174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.597230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be created. [ 1312.657294] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.657493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1312.657493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1312.658331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1312.658533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1312.670442] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1313.162373] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: SUCCESS [ 1313.162595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.162745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.162979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.163209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.163331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.163396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.163581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.163671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.163774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.163891] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.181417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.181598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.181598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.181817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.181927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.182080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.182183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.182292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.183095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.183258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.183352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.183443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.183702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.183798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.183914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.184109] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.184213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.184262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.184394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.184468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.184620] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.184736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.184783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.184899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.185031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.185117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.185177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.185307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.185381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.185460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.185550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.192586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41457c53-0beb-498e-9602-79d16e17cd73: rpc.has_security_group_logging(os_id): False [ 1313.211848] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.212055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.212055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.212266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.212360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.212546] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.212641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.212701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.212911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.212911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.213100] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.213197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.213272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.213805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.213805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.213805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.213805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.213967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.213995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.214082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.214146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 is going to be created. [ 1313.273035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.273248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1313.273248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1313.273483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1313.273914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1313.286544] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: IN_PROGRESS for 2s [ 1314.683854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1314.684191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1315.296990] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: SUCCESS [ 1315.296990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1316.013287] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.013287] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.272821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-d3cb2256-1ebc-4ce9-82fc-269b5a078d1c None None] Enqueued Resource ID: bd12ae4e-0dd6-4854-a731-acae0e064015 with Priority: HIGHEST for action port [ 1316.272821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd12ae4e-0dd6-4854-a731-acae0e064015 with Priority: HIGHEST for action port [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd12ae4e-0dd6-4854-a731-acae0e064015 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd12ae4e-0dd6-4854-a731-acae0e064015" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd12ae4e-0dd6-4854-a731-acae0e064015" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd12ae4e-0dd6-4854-a731-acae0e064015" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1316.272821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd12ae4e-0dd6-4854-a731-acae0e064015',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.403742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd12ae4e-0dd6-4854-a731-acae0e064015 [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1316.403742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd12ae4e-0dd6-4854-a731-acae0e064015 already deleted. [ 1316.403742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd12ae4e-0dd6-4854-a731-acae0e064015" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1317.984346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-f980aae4-fa3d-42ec-bbde-e1e80128fe43 None None] Enqueued Resource ID: 565627ba-35cf-4b48-b966-840ad777e94f with Priority: HIGHEST for action port [ 1317.984346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565627ba-35cf-4b48-b966-840ad777e94f with Priority: HIGHEST for action port [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-565627ba-35cf-4b48-b966-840ad777e94f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565627ba-35cf-4b48-b966-840ad777e94f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565627ba-35cf-4b48-b966-840ad777e94f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565627ba-35cf-4b48-b966-840ad777e94f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1317.984346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565627ba-35cf-4b48-b966-840ad777e94f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.995749] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 565627ba-35cf-4b48-b966-840ad777e94f [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1317.995749] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:565627ba-35cf-4b48-b966-840ad777e94f already deleted. [ 1317.995749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565627ba-35cf-4b48-b966-840ad777e94f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1322.983064] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.983430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.984529] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.984803] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.986050] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.986463] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.987406] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.987690] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.988122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.988389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.989416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.989752] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.990972] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.990972] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.991744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.992039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.939055] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e2749e1d-456c-4dd8-93cb-2ff052264a7c req-1a676423-b14c-42ce-b827-882324c84c59 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1359.939583] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1359.939897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.940048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1359.940396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1359.940396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1359.940396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1359.940565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.940668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1359.940723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1359.940909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1359.941312] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.941473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1359.941513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1359.941627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1359.941763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1359.941810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.952293] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.952420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1359.952494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1359.952676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1359.952766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1359.952948] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.953049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1359.953112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1359.953397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1359.953482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1359.953570] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 already deleted. [ 1359.953650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.177275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-1b5e8b6e-61ab-4e5f-b2d4-b63393e4a120 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1360.177828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1360.178150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.178310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.178416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.178664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.178754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.178920] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.179019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.179083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.179277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.179358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.215620] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.215829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.215829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.216052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.216155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.216255] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 already deleted. [ 1360.216341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.266202] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-d48e52e1-3bcb-43fa-843a-c4e80e468b04 req-05a1125a-94fd-4f07-8be1-171ff7e84719 tempest-SecurityGroupsTestJSON-1742011264 tempest-SecurityGroupsTestJSON-1742011264-project-member] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1360.266716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1360.267040] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.267195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.267302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.267549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.267642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.267888] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.268109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.268193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.268464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.268613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.268717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.268801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.268950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.269035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.269257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.287453] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f already deleted. [ 1360.287453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.355884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-4c638aad-b7d6-4203-b361-9c507f48591f tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1360.356436] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1360.356760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.356885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.356955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.357184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.357278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.357474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.357595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.357673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.357897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.357978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.392414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.392569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.392638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.392864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.392951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.393044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 already deleted. [ 1360.393135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.660567] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.660771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.660899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.661179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.661328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.661596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-207 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.661790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.661914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.662222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.662468] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.662628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.662760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.662967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.663111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.663261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.663509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.663665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.663783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.663986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.664381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.664627] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-34015933-cffc-43a3-a4bf-69cebe879507 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.664782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.664900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.665139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.665279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34015933-cffc-43a3-a4bf-69cebe879507',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.684749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.685117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.685403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.685635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.685804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.685975] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 34015933-cffc-43a3-a4bf-69cebe879507 not found, creating... [ 1360.686257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.686433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.686555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.686793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.686935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.687227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.687400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.687521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.687760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.687921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.688088] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 34015933-cffc-43a3-a4bf-69cebe879507 is going to be created. [ 1360.711524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.711794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.712988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.713412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.713679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.713928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.802877] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.803160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.803205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.803478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.803626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.803922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-685 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.804122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.804285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.804641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.804906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.805097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.805224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.805458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.805623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.805789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.806276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.806466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.806592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.806809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.806975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.807228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.807412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.807536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.807791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.808035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9f5b9f-61fc-44d8-8dac-fd3773a35ace',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.827653] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.827938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.828066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.828348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.828503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.828660] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace not found, creating... [ 1360.828950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.829104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.829222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.829448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.829589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.829874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.830033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.830156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.830364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.830500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.830643] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace is going to be created. [ 1360.856411] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.856696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1360.857080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1360.857410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1360.857660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1360.857980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.132923] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e2749e1d-456c-4dd8-93cb-2ff052264a7c req-cc4aa38a-3027-4cbb-8ec5-24ae2c1bae09 service neutron] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1361.133193] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e2749e1d-456c-4dd8-93cb-2ff052264a7c req-cc4aa38a-3027-4cbb-8ec5-24ae2c1bae09 service neutron] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1361.133245] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e2749e1d-456c-4dd8-93cb-2ff052264a7c req-cc4aa38a-3027-4cbb-8ec5-24ae2c1bae09 service neutron] Enqueued Resource ID: 34015933-cffc-43a3-a4bf-69cebe879507 with Priority: HIGHEST for action port [ 1361.133455] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_rules [ 1361.133578] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1361.133669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34015933-cffc-43a3-a4bf-69cebe879507 with Priority: HIGHEST for action port [ 1361.134223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.134336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.134396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.134587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.134664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.134815] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.134905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.134961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.135097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.135168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.136048] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.136451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.136519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.136680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.136750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.136891] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.136980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.137038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.137221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.137305] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.138503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.138503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.138503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.138503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.138503] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.139070] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.139070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.139159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-34015933-cffc-43a3-a4bf-69cebe879507 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.142886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34015933-cffc-43a3-a4bf-69cebe879507',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.159352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.172987] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34015933-cffc-43a3-a4bf-69cebe879507 with status ACTIVE [ 1361.173202] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.173362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.173470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.173693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.173786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.173977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.174085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.174149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.174300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.174378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.176117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.181396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.181527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.181595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.181794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.181881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.182041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.182124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.184613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.184930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.184930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.185031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.185065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.185130] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be created. [ 1361.380456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-d48e52e1-3bcb-43fa-843a-c4e80e468b04 req-fbcd31f4-d7b2-4908-a2ed-aa508e720699 service neutron] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_rules [ 1361.380643] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-d48e52e1-3bcb-43fa-843a-c4e80e468b04 req-fbcd31f4-d7b2-4908-a2ed-aa508e720699 service neutron] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1361.380786] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-d48e52e1-3bcb-43fa-843a-c4e80e468b04 req-fbcd31f4-d7b2-4908-a2ed-aa508e720699 service neutron] Enqueued Resource ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with Priority: HIGHEST for action port [ 1361.381014] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_rules [ 1361.381146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1361.381256] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with Priority: HIGHEST for action port [ 1361.381822] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.381960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.382008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.382213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.382308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.382450] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.382547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.382609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.382807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.382889] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.384027] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.384136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.384432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.384595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.384679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.384828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.384924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.384988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.385128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.385266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.385356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.385417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.385584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.385678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.385787] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.386577] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.386677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.386744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.386890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.386967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.387106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.387193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.387309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.387371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.387445] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9f5b9f-61fc-44d8-8dac-fd3773a35ace',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.413364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.414621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.414729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.414794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.415009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.415124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.415244] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.415337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.428302] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.429081] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with status ACTIVE [ 1361.429263] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.429384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.429448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.429643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.429738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.429907] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.429996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.430138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.430195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.430270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.438323] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.438451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.438519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.438708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.438839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.438890] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be created. [ 1361.472825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.473060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.473060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.473263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.473442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.491743] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: UNINITIALIZED for 2s [ 1361.659159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.659353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.659397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.659631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.659676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.659775] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34015933-cffc-43a3-a4bf-69cebe879507 is going to be updated. [ 1361.679833] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.680011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.680106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.680346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.680480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.680644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.857260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.857560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.857560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.857707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.857872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.857981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace is going to be updated. [ 1361.883678] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.884570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1361.884570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1361.884570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1361.884570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1361.884570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.151779] neutron-nsxv3-agent[62156]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/18832a39-e87e-45f8-beda-f4a5d65556d4', 'data': {'id': '18832a39-e87e-45f8-beda-f4a5d65556d4', 'display_name': '18832a39-e87e-45f8-beda-f4a5d65556d4', 'path': '/infra/domains/default/groups/18832a39-e87e-45f8-beda-f4a5d65556d4', 'expression': [{'value': 'security_group|18832a39-e87e-45f8-beda-f4a5d65556d4', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.14']}], 'tags': [{'scope': 'age', 'tag': 1707211173}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1362.152175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=62156) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1362.318207] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4ec86499-99c2-4dee-ab4e-ba18e0090a83 req-5c0c0074-27f8-4772-986c-618892accae1 tempest-ServerRescueNegativeTestJSON-959391720 tempest-ServerRescueNegativeTestJSON-959391720-project-member] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 1362.318207] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGHEST for action security_group_members [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.318207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.328018] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.328155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.328200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.328473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.328473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.328657] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.328754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.328824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.329026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.329175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.329318] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be updated. [ 1362.373824] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.374038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1362.374103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1362.374484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1362.374816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1362.384503] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: IN_PROGRESS for 2s [ 1363.511579] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.511579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.524825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.525607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.550580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ab204b-f602-43f2-b825-e60a546adb0f: rpc.has_security_group_logging(os_id): False [ 1363.568739] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca882aac-9d98-485b-bc8d-4d0b65396ae6 req-73d5a409-6e63-41cd-b0f5-c60cbd374693 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1363.568739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.568739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.568739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.568739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.568739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.570809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.572362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.572362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.572362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.572362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.572362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.572362] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be created. [ 1363.573920] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1363.574633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.574918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.575170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.575498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.575743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.576095] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.576386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.576581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.576877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.577153] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.577367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.577531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.577767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.577972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.578154] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.587319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.588545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.588758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.589191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.589482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.589818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.590057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.590513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.590799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.591012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.591254] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d already deleted. [ 1363.591475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.640684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.640900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1363.640951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1363.641211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1363.641465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1363.654565] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1364.151886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.151886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.151886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.152220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.152259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.152530] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-445 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.152694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.152816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.153110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.153359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.153518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.153640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.153980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.153980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.154148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.154397] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.154553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.154674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.154883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.155167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.155264] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.155418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.155539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.155800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.156026] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.171123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.171334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.171463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.171730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.171886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.172213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 not found, creating... [ 1364.172456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.172642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.172768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.172988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.173134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.173418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.173578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.173700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.173905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.174043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.174291] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 is going to be created. [ 1364.178867] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.179032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.179107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.179272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.179422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.188517] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: UNINITIALIZED for 2s [ 1364.195994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.195994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.195994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.195994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.196647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.196647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.394585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 in Status: SUCCESS [ 1364.394765] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 deletion is rescheduled due to dependency. [ 1364.394887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.506226] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca882aac-9d98-485b-bc8d-4d0b65396ae6 req-65bedcf4-5274-430f-8f9c-106528628cdd service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 1364.506406] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca882aac-9d98-485b-bc8d-4d0b65396ae6 req-65bedcf4-5274-430f-8f9c-106528628cdd service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1364.506540] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca882aac-9d98-485b-bc8d-4d0b65396ae6 req-65bedcf4-5274-430f-8f9c-106528628cdd service neutron] Enqueued Resource ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with Priority: HIGHEST for action port [ 1364.506776] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 1364.506902] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1364.506993] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with Priority: HIGHEST for action port [ 1364.507563] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.507701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.507753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.507999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.508104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.508319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.508389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.508422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.508599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.508672] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.509651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.509813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.509882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.510034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.510110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.510277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.510350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.510431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.510572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.510707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.510794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.510860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.510982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.511087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.511175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.512143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.512143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.512143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.512447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.512447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.512509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.512573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.512738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.512796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.512828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.525979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.533543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.533688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.533767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.534118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.534211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.534379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.534457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.537117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.541896] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with status ACTIVE [ 1364.542079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.542194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.542286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.542480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.542568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.542752] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.542852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.542916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.543062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.543141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.548068] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.548215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.548276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.548403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.548486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.548577] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be created. [ 1364.584431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.584745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1364.584840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1364.585088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1364.585267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1364.597039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: UNINITIALIZED for 2s [ 1365.088037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.088245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1365.088245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1365.088454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1365.088577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1365.088682] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 is going to be updated. [ 1365.111421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.111574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1365.111655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1365.111866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1365.112027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1365.112186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1365.666971] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1365.667374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.198415] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: SUCCESS [ 1366.198580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.198730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.198977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.199167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.199281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.199342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.199495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.199571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.199652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.199767] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.208656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.214693] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18832a39-e87e-45f8-beda-f4a5d65556d4: rpc.has_security_group_logging(os_id): False [ 1366.232578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.232722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.232795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.232999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.233095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.233335] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.233428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.233495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.233652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.233698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.233779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be created. [ 1366.288128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.288302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.288345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.288542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.288729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.299358] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: IN_PROGRESS for 2s [ 1366.608031] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.608031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.608391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.608391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.608391] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.618327] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.618459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.618531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.618712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.618797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.618959] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.619058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.619122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.619263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.619403] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.619494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.619554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.619689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.619767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.619849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.619999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.620153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.620262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.620326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.620398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.620539] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.620642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.620719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.620861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.620998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.621088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.621148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.621312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.621391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.621471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.621558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.627586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.646175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.646548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.646548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.646614] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.646659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.646800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.646949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.646949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.647142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.647264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.647305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.647492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.647492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.647561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be created. [ 1366.708969] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.709325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1366.709325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1366.709399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1366.709537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1366.719495] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1368.311950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: SUCCESS [ 1368.312303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1368.732702] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1368.732935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1369.507899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.508185] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.509604] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.510044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.510582] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.510891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.512279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.512536] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.513192] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.513568] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.514721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.514996] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.515585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.515917] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.516987] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.517251] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.655779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-3d95f8f4-42e1-4ee0-a842-46d0c2b7bbdb req-23e923f3-8816-4962-a674-72802cf48ca6 tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1407.658544] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1407.658948] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.659160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.659160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.659356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.659437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1407.659586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.659678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.659735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.659876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.660027] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.660532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.660532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.660532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.660532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1407.660532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.675482] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.675626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.675694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.675905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.675996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1407.676282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.676346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.676382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.676529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.676602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1407.676693] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1407.707303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.707471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1407.707530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1407.707754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1407.707920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1407.717888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1408.807375] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-811958e5-978f-4d29-b780-3245490a954c req-1915173c-3553-4a83-9fc3-54bb5d820fcb tempest-ImagesTestJSON-226226016 tempest-ImagesTestJSON-226226016-project-member] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1408.807888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1408.808224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.808378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1408.808440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1408.808600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1408.808682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1408.808842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.808945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1408.809015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1408.809200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1408.809340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.809432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1408.809491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1408.809627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1408.809704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1408.809789] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.822805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.822953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1408.823039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1408.823226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1408.823314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1408.823503] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.823596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1408.823653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1408.823790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1408.823862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1408.823944] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f already deleted. [ 1408.824032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.150480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.150480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.150480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.150772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.150929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.151193] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-219 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.151351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.151472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.151745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.152240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.152462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.152605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.152823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.152982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.153138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.153390] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.153544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.153663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.153865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.154003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.154240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-80131c19-baa0-4896-9681-6b5a4d061684 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.154391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.154508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.154750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.154890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80131c19-baa0-4896-9681-6b5a4d061684',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.176831] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.177067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.177210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.177477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.177629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.177781] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 80131c19-baa0-4896-9681-6b5a4d061684 not found, creating... [ 1409.178112] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.178310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.178434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.178647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.178783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.179104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.179260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.179398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.179600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.179735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.179912] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 80131c19-baa0-4896-9681-6b5a4d061684 is going to be created. [ 1409.201021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.201303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.201432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.201726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.201972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.202567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.512918] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-811958e5-978f-4d29-b780-3245490a954c req-5086a695-a7e1-4508-b53a-608e5af72cf0 service neutron] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_rules [ 1409.513093] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-811958e5-978f-4d29-b780-3245490a954c req-5086a695-a7e1-4508-b53a-608e5af72cf0 service neutron] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1409.513232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-811958e5-978f-4d29-b780-3245490a954c req-5086a695-a7e1-4508-b53a-608e5af72cf0 service neutron] Enqueued Resource ID: 80131c19-baa0-4896-9681-6b5a4d061684 with Priority: HIGHEST for action port [ 1409.513459] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_rules [ 1409.513585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1409.513676] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80131c19-baa0-4896-9681-6b5a4d061684 with Priority: HIGHEST for action port [ 1409.514249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.514367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.514434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.514626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.514718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.514911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.514975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.515011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.515476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.515476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.516126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.516232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.516295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.516440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.516514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.516654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.516741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.516800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.516943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.517077] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.517165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.517352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.517494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.517572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.517655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.518690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.518790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.518880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.519472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.519472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.519472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-80131c19-baa0-4896-9681-6b5a4d061684 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.519472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.519693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.519729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.519834] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80131c19-baa0-4896-9681-6b5a4d061684',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.532387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.542621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.551288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.551430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.551500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.551712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.551798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.551966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.552078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.552585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.552689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.552752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.552906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.552987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.553072] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be created. [ 1409.555791] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80131c19-baa0-4896-9681-6b5a4d061684 with status ACTIVE [ 1409.555954] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.556071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.556142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.556286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.556365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.556523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.556613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.556672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.556807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.556879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.597033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.597186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.597250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.597456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.597624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.616042] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: UNINITIALIZED for 2s [ 1409.728024] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1409.728268] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 deletion is rescheduled due to dependency. [ 1409.728393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.954418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.954816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.954816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.954893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.954928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.955034] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80131c19-baa0-4896-9681-6b5a4d061684 is going to be updated. [ 1409.975030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.975030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1409.975030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1409.975477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1409.975477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1409.975477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.626067] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1411.626383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.626587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.626832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.627131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.627362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.627362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.627493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.627578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.627664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.627754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.636652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.636782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.636855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.637038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.637121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.637287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.637388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.637532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.637579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.637725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.637816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.637921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.638067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.638149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.638231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.638381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.638473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.638535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.638671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.638742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.638909] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.638999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.639060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.639194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.639332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.639420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.639478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.639613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.639689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.639767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.639853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.649898] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 1411.671258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.671399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.671469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.671673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.671764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.671988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.672110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.672170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.672378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.672434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.672585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.672679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.672736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.672875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.672951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.673131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.673222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.673278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.673413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.673489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.673571] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be created. [ 1411.732842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.732842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1411.732842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1411.733099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1411.733254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1411.747582] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1413.761086] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1413.761431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1414.515356] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.515572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.516388] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.516676] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.517685] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.518017] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.519181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.519431] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.520416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.520687] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.521490] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.521767] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.522698] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.522698] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.524496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.524867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.525772] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.526120] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.338864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-63eb822a-63ac-4d21-a5f4-d61859f4792c req-44fd6dbb-99ed-420d-91b9-e9a1f33b58c1 tempest-ImagesOneServerTestJSON-549668524 tempest-ImagesOneServerTestJSON-549668524-project-member] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1457.339390] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGHEST for action security_group_members [ 1457.339724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.339842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.339906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.340147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.340230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1457.340389] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.340482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.340539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.340685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.340819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.340906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.340964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.342811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.342811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1457.342811] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.351744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.351894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.351971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.352263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.352365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1457.352641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.352769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.352872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.353056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.353140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1457.353228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be updated. [ 1457.385191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.385370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1457.385431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1457.388532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1457.388532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1457.395639] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: IN_PROGRESS for 2s [ 1459.407260] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 105ab1e0-aa9d-412e-9840-c617dca8aede in Status: SUCCESS [ 1459.407546] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede deletion is rescheduled due to dependency. [ 1459.407546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.482730] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b31b9af3-67b4-4d42-82c2-188cb56771db req-9a6d0a87-297e-4a80-bd3b-d99168f0b1ad tempest-ServersNegativeTestJSON-1891512129 tempest-ServersNegativeTestJSON-1891512129-project-member] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1459.482730] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1459.482730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.482730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.482730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.482730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.482730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.483042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.483042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.483042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.483178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.483214] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.483311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.484028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.484028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.484028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.484028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.493755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.493930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.493977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.494141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.494226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.494403] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.494495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.494556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.494693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.494766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.494860] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 already deleted. [ 1459.494921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.860172] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.860410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.860541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.860810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.860958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.861223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-956 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.861459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-956" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.861601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-956" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.861876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-956" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.862132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.862289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.862413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.862713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.862878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.863036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-956" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.863292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.863467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.863554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.863766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.863920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.864167] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-17e02792-762e-43fb-88ac-ed1f53e7aa90 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.864354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.864449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.864711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.864856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e02792-762e-43fb-88ac-ed1f53e7aa90',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.879625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.879871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.880044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.880333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.880493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.880647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 17e02792-762e-43fb-88ac-ed1f53e7aa90 not found, creating... [ 1459.880901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.881066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.881187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.881403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.881548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.881831] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.881992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.882127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.882355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.882509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.882655] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 is going to be created. [ 1459.908547] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.908547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1459.908547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1459.908880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1459.908922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1459.909165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.456375] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b31b9af3-67b4-4d42-82c2-188cb56771db req-f3db7500-d398-4091-b711-90563c88fa5c service neutron] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_rules [ 1460.456654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b31b9af3-67b4-4d42-82c2-188cb56771db req-f3db7500-d398-4091-b711-90563c88fa5c service neutron] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1460.456693] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b31b9af3-67b4-4d42-82c2-188cb56771db req-f3db7500-d398-4091-b711-90563c88fa5c service neutron] Enqueued Resource ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 with Priority: HIGHEST for action port [ 1460.456903] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_rules [ 1460.457034] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1460.457128] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 with Priority: HIGHEST for action port [ 1460.457695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.457819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.457921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.458106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.458221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.458344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.458441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.458501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.458692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.458769] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.459840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.459959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.460289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.460463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.460549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.460701] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.460798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.460862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.461005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.461142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.461231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.461292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.461615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.461665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.461756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.465693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.465812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.465881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.466079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.466162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.466378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e02792-762e-43fb-88ac-ed1f53e7aa90 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.466446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.466477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.466603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.466682] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e02792-762e-43fb-88ac-ed1f53e7aa90',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.475426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.493771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.494229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.494703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.495092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.495306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.496102] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.496450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.500394] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.501867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17e02792-762e-43fb-88ac-ed1f53e7aa90 with status ACTIVE [ 1460.502194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.502479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.502660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.502948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.503483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.504183] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.504452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.505117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.505551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.505760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.509056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.509434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.509607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.509897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.510092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.510278] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be created. [ 1460.727508] neutron-nsxv3-agent[62156]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/9014b003-e476-4ebb-b600-3ffb812c8241', 'data': {'id': '9014b003-e476-4ebb-b600-3ffb812c8241', 'display_name': '9014b003-e476-4ebb-b600-3ffb812c8241', 'path': '/infra/domains/default/groups/9014b003-e476-4ebb-b600-3ffb812c8241', 'expression': [{'value': 'security_group|9014b003-e476-4ebb-b600-3ffb812c8241', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.4']}], 'tags': [{'scope': 'age', 'tag': 1707211273}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1460.727508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=62156) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1460.872056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.872056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.872056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.872590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.872590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.872590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 is going to be updated. [ 1460.896856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.897010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1460.897086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1460.897302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1460.897451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1460.897614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.751163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.751542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.751542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.751542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.751657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.761126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: UNINITIALIZED for 2s [ 1464.772761] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: SUCCESS [ 1464.773101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.773101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.773303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.773475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.773584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.773647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.773791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.773867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.773954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.774044] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.784940] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.785124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.785189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.785312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.785391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.785544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.785653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.785712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.785833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.785974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.786061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.786122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.786254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.786332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.786462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.786636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.786741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.786832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.786922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.786997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.787137] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.787227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.787293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.787416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.787552] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.787641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.787700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.787830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.787925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.788015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.788102] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.793716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9014b003-e476-4ebb-b600-3ffb812c8241: rpc.has_security_group_logging(os_id): False [ 1464.810173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.810386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.810386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.810569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.810658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.810860] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.810959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.811019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.811158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.811231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.811414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.811502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.811559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.811687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.811762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.811935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.812033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.812094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.812224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.812298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.812384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be created. [ 1464.867649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.867788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1464.867914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1464.868164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1464.868365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1464.878876] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: IN_PROGRESS for 2s [ 1465.457767] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.457881] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1466.893952] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: SUCCESS [ 1466.894409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1469.825750] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1469.826093] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1470.459055] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.459245] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.460180] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.460482] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.461054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.461396] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.462265] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.462618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.463146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.463449] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.464423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.464740] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.465623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.465623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.708555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.708831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1501.708831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1501.709109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1501.709201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1501.709391] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.709490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1501.709552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1501.709702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1501.709801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.718629] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.727173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.733222] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1501.733324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1502.319180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.319401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.319401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.319600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.330306] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1502.330743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.331496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1502.373356] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.373567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.373567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.373774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.386784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.387638] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:2. [ 1502.387725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'1e6107e9-4b4b-4df4-95a1-bbdce9d22d38', 'de32e2b9-325c-4cef-aeef-41d12097a237'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1502.387821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1502.411815] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.412099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.412099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.412274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.412843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.412990] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1502.455250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.455388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.455444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.455629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.455864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.456071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1502.501892] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.502202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.502202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.502359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.502480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.502667] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:14. [ 1502.502750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'105ab1e0-aa9d-412e-9840-c617dca8aede', '9c61b63d-18fa-4fbd-b651-ed6a9bd62170', '518a0bec-8c5a-406d-bdb3-ca7657d7078f', '41457c53-0beb-498e-9602-79d16e17cd73', 'a7ab204b-f602-43f2-b825-e60a546adb0f', 'e0033677-0a6e-4486-8a4a-fa6c2b550528', '7c221fa9-d7c5-4f9e-a059-1a11c92487e0', '9014b003-e476-4ebb-b600-3ffb812c8241', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', '18832a39-e87e-45f8-beda-f4a5d65556d4', 'e99a9006-ba9f-4366-9e90-536f58fe86a5', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1502.502873] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1502.523497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.523815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.523815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.524230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.524230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.524528] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1502.524528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1502.524528] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1502.567760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.567964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.568075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.568263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.568801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.569001] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1502.569141] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1502.569220] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1502.569280] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 2/2 resources of Type:Ports [ 1502.569368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e6107e9-4b4b-4df4-95a1-bbdce9d22d38 with Priority: HIGH for action port [ 1502.569448] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de32e2b9-325c-4cef-aeef-41d12097a237 with Priority: HIGH for action port [ 1502.569516] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 14/14 resources of Type:Security Group Rules [ 1502.569574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_rules [ 1502.569636] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1502.569691] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1502.569746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_rules [ 1502.569800] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1502.569858] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1502.569919] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1502.569981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1502.570040] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1502.570095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1502.570150] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1502.570207] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1502.570265] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_rules [ 1502.570322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 1502.570380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1502.570434] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1502.570586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.570686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.570753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.570894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.570972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.571138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.571224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.571286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.571403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.571464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.571630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.571724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.571782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.571896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.571968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.572143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.572274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.572362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.572504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.572569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.572688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.572770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.572825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.572954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.573027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.573188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.573270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.573333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.573453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.573524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.573685] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.573766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.573823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.573948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.574085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.574259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.574259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.574405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.574470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.574530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.574674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.574878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.574878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.574997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.574997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.575165] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.575252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.575362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.575420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.575482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.575643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.575722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.575797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.576029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.576100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.576266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.576351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.576407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.576534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.576607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.576776] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.576866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.576924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.577042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.577115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.577276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.577357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.577413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.577539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.577611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.577770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.577897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.577995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.578099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.578164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.578330] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.578417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.578473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.578593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.578657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.578819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.578909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.578968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.579106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.579183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.579309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.579387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.579443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.579567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.579640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.579798] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.579886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.579944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.580075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.580146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.580308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.580388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.580443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.580582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.580672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.580851] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.580956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.581015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.581152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.581223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.581386] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.581469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.581525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.581675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.581754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.581937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.582040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.582115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.582241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.582333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.582497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.582582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.582640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.582765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.582843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.583030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.583139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.583224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.583398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.583480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.583664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.583780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.583860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.584037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.584134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.584357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.584455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.584541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.584701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.584817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.585020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.585123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.585182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.585359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.585454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.585649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.585772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.585864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.586046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.586132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.586302] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.586394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.586453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.586582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.586654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.586759] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1502.586828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1502.586888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1502.632417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.632654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.632654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.632783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.633020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.633194] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1502.674632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.674970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1502.674970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1502.675109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1502.675253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1502.717671] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1502.717999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.657035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-aa648d57-d92f-4d9c-8df7-94ae0280e5b8 req-57cdc876-19d2-4ef4-bc9b-636e1ebe1018 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1503.657554] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGHEST for action security_group_members [ 1503.657703] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6107e9-4b4b-4df4-95a1-bbdce9d22d38 with Priority: HIGH for action port [ 1503.657806] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_rules [ 1503.657936] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1503.658047] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_rules [ 1503.658122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1503.658214] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1503.658302] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 1503.658392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1503.658481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1503.658567] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1503.658652] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1503.659006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_rules [ 1503.659006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_rules [ 1503.659006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1503.659145] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1503.659145] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de32e2b9-325c-4cef-aeef-41d12097a237 with Priority: HIGH for action port [ 1503.659233] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_rules [ 1503.659523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.659657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.659699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.659890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.659971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.660141] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.660228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.660291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.660436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.660573] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.660660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.660719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.660851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.660931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.661019] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.661857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.661970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.662038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.662186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.662260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.662397] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6107e9-4b4b-4df4-95a1-bbdce9d22d38 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.662488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6107e9-4b4b-4df4-95a1-bbdce9d22d38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.662548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6107e9-4b4b-4df4-95a1-bbdce9d22d38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.662721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6107e9-4b4b-4df4-95a1-bbdce9d22d38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.662794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6107e9-4b4b-4df4-95a1-bbdce9d22d38',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.663912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.672066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.672186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.672367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.672454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.672609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.672707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.672771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.672915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.672988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.673818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.674002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.674002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.674134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.674209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.674350] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.674442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.674503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.674636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.674706] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.675449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.675551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.675631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.675759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.675833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.675971] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.676217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.676217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.676320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.676320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.677848] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.678055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.678055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.678199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.678276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.678417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.678502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.678558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.678693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.678760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.679613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.679711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.679779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.679924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.680048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.680154] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.680244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.680304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.681215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.688097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.689143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.689285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.689356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.689537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.689617] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.689768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.689859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.689922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.690061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.690135] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.690932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.691011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.691061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.691203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.691279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.691416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.691505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.691566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.691699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.691769] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.692492] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.692614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.692662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.692807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.692883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.693022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.693112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.693172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.693308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.693377] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.695682] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.695789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.695856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.696057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.696104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.696249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.696352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.696388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.696523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.696591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.697275] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.697374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.697440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.697585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.697660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.697795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.697897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.697965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.698123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.698213] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.698890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.699026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.699103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.699259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.699322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.699461] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.699551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.699611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.699744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.699811] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.700505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.700612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.700678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.700821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.700895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.701034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.701117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.701176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.701309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.701377] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.702144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.702249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.702314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.702458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.702545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.702661] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.702750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.702810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.702964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.702998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.703946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.703946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.703946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.703946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.704112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.704152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-de32e2b9-325c-4cef-aeef-41d12097a237 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.704246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de32e2b9-325c-4cef-aeef-41d12097a237" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.704307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de32e2b9-325c-4cef-aeef-41d12097a237" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.704482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de32e2b9-325c-4cef-aeef-41d12097a237" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de32e2b9-325c-4cef-aeef-41d12097a237',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.706976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.708906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.709029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.709097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.709358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.735264] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e6107e9-4b4b-4df4-95a1-bbdce9d22d38 [ 1503.735504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.735504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.735620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.736038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.736038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.740406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.742232] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.742232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.742232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.742232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.742232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.742232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 is going to be updated. [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.763570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.764088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.764088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.764088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.764611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.764727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.764821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.764911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.768619] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.768756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.768794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.769044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.770841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.770959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.771028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.771184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.771264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.771414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.771508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.771572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.771710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.771850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.771942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.772013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.772166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.772316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.772316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.772403] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.782195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.782343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.782427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.782627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.782778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.800149] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: IN_PROGRESS for 2s [ 1503.803069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.803176] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be deleted. [ 1503.806742] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de32e2b9-325c-4cef-aeef-41d12097a237 [ 1503.806942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.807063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.807129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.807323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.807408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.817504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.817643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.817714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.818355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.818355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.818355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.818355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.818355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.818594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.818842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.818842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.818842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.819004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.820961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.820961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.820961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.821665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.821776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.821843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.822001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.822128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.822229] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.822321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.822415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.822520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.822659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.822814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.822951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.823745] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.824077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.824077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.824077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.824785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.824888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.824951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.825094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.825170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.825249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.825332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.831068] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.831885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.832031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.832103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.832304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.832460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.832592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.832724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.832787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.832952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.833097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.833186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.833245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.833378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.833455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.833535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.833615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.836573] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.836691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.836973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.836973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.836973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.837111] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.837666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.837943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.837943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.837943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.838045] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.838853] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.838962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.839016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.839181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.839228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.839368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.839455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.839513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.839643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.839774] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.839901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.839960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.840147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.840232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.840313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.840689] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.841131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.841228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.841291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.841439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.841507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.841664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.841761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.841820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.841955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.842087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.842174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.842232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.842356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.842428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.842503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.842577] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.848209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.848359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.848427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.848623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.848721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.848866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.848964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.849026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.849172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.849315] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.849406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.849469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.849600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.849681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.849786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.849840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.866758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.866937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.866995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.867216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.867305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.867477] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.867578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.867643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.867842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.867953] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.868075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.868137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.868283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.868365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.868447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.868600] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.868697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.868747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.868908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.869002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.869388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.869388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.869388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.869538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.869538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.869615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.869674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.869801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.869876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.869958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.870044] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.872459] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 1503.873570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.873690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.873759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.873931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.874100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.874151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.874244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.874304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.874444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.874607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.874729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.874831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.874931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.875013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.875093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.875177] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.876797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.876911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.877005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.877139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.878891] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.879022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.881169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.881230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.883034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.883234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.884040] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18832a39-e87e-45f8-beda-f4a5d65556d4: rpc.has_security_group_logging(os_id): False [ 1503.885297] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.885395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.885437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.885643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.885750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.885928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.886047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.886128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.886299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.886765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.886765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.886765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.886893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.887298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.887298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.887298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.887298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.887770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.887770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.887770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.887879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.887962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.888072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.888235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.888399] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.888581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.888618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.888766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.889067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.889067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.889067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.892622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.892774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.892877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.893078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.893213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.893424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6107e9-4b4b-4df4-95a1-bbdce9d22d38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.893735] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.893875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.893965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.894141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.894251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.894427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.894546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.894653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.894792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.894979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.895050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.895108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.895244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.895317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.895464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.895642] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.895762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.895823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.895994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.896113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.896267] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.896385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.896473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.896635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.896876] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.896962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.897007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.897150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.897244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.897347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.897452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.898497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.898497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.898633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.898758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.898838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.899270] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.899270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.899270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.899432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.899592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.899826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.899826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.899951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.900058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.900163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.900340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.900451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.900528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.900701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.900850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.900967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.901059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.901117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.901290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.901449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.901575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.901655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.901826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.901910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.902012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.902115] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.903195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.903296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.903524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.903524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.903622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.903795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.905440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.905556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.905741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.905928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.906055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.906119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.906471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.906471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.906575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.906750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.906875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.906977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.907222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.907320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.907623] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.907623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.907750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.907893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.908087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.908166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.908253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.908421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.908537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.908644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.909065] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.914724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.914876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.915191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.915404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.915526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.915703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de32e2b9-325c-4cef-aeef-41d12097a237" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.916185] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41457c53-0beb-498e-9602-79d16e17cd73: rpc.has_security_group_logging(os_id): False [ 1503.917586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1503.919123] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ab204b-f602-43f2-b825-e60a546adb0f: rpc.has_security_group_logging(os_id): False [ 1503.920780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.920780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.920780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.920966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.921014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.921653] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.921791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.921885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.922072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.922250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.922380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.922455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.922960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.923100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.923246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.923438] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.923861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.924120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.924166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.924310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.924438] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.924601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.924676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.925198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.925393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.925523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.925611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.926131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.926131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.926131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.926131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.927199] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.927343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.927432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.927657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.927720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.927879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.928047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.928137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.928361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.928490] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.928633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.928709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.928952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.929064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.929174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.929347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.929494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.929783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.929783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.929783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.929986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.930107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.930196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.930414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.930597] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.930733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.930817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.931004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.931084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.931738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.931842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.932768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9014b003-e476-4ebb-b600-3ffb812c8241: rpc.has_security_group_logging(os_id): False [ 1503.937553] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.937654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.937979] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0033677-0a6e-4486-8a4a-fa6c2b550528: rpc.has_security_group_logging(os_id): False [ 1503.939555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.939665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be deleted. [ 1503.941135] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.941236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.941278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.941456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.942739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.942856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.943199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 1503.945793] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 1503.969742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.969930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.970666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.970784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.973080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.973222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.974256] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.974353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.975339] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.975440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.985200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.985392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.987419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.988054] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.988054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.988054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.988320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.988443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.988702] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.988957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.988957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.989182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.989390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.989549] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.989655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1503.989755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.989943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1503.990055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1503.990181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1503.991468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1503.991684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.026303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.026446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.036146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.036323] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be deleted. [ 1504.037682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.038172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.074812] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.075022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.081789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.081951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.082055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.082124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.082327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.082414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.082544] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be updated. [ 1504.083666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.083845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.083936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.084560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.084560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.084560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.084560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.084779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 is going to be deleted. [ 1504.085543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.085707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.129325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.129630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.129756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.129828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.130073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.130158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.130362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.130463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.130520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.130672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.130749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.131223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.131223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.131223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.131223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.131389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.131389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1504.132710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.132877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.157610] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.157610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.174813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.175116] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.175250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.175321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.175528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.175615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.175845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.176060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.176130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.176283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.176360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.176555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.176636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.176697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.176835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.176913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.177004] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be updated. [ 1504.178285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.178440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.180680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.180795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.221617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.221828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.227030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.227159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.240399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.240686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.240806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.240875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.241081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.241162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.241358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.241455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.241518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.241663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.241740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.241927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.242009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.242070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.242205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.242354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.242451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1504.243565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.243728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.284847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.285002] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be deleted. [ 1504.285969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.286187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.286280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.286408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.286573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.286724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.304818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.305010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.313429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.313627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.317669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.318117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.318278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.318361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.318642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.318741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.319227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.320092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.320407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.320512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.320620] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1504.321797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.321978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.350736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.351057] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.351182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.351243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.351447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.351530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.351753] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.351834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.351892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.352092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.352212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.352461] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.352554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.352554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.352678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.352751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.352840] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be updated. [ 1504.353999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.354158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.400794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.401131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.401273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.401321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.401741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.401741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.401870] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.401938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.401973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.402115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.402198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.402371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.402458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.402517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.402642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.402719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.402814] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 is going to be updated. [ 1504.404054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.404248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.404338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.404472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.404770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.404770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.404888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.406035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.406203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.439455] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: IN_PROGRESS for 2s [ 1504.462468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.462785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.462913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.462986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.463196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.463282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.463485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.463584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.463647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.463789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.463867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.464072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.464156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.464220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.464361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.464439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.464533] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1504.465712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.465899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.466038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.467327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.468262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.468262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.468593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.468752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.468838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.468970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.469125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.469271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.469398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.487296] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1504.488292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.488419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.488460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.488642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.488796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.490422] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: IN_PROGRESS for 2s [ 1504.498839] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1504.501142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.501350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.501416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.501583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.501703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.501856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.505684] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1504.538260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.538437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.538437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.538683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.538774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.584884] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.585160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.585160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.585303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.585453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.587632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.587809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.587881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.588104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.588262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.590315] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1504.614168] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: IN_PROGRESS for 2s [ 1504.614972] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: IN_PROGRESS for 2s [ 1504.618094] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.618320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.618320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.618514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.618673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.638788] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1504.779654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-749f5d95-ad12-4300-826e-48971f0d6f74 req-4c9b5014-d98f-4fa4-be04-3bbf4cda834f tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1504.780259] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1504.780575] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.780697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.780774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.780959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.781046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.781204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.781320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.781397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.781526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.781670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.781752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.781820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.781946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.782027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.782117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.794344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.794487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.794557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.794748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.794833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.795019] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.795115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1504.795200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1504.795510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1504.795510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1504.795510] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 already deleted. [ 1504.795669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.180335] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.180580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.180765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.181106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.181328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.181687] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-467 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.181912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.182087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.182392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.182772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.183046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.183176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.183460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.183663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.183887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.184252] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.184467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.184654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.184937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.185128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.185448] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-a931f062-eeeb-4c6e-b429-dba949650ec9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.185653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.185841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.186161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.186335] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a931f062-eeeb-4c6e-b429-dba949650ec9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.212535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.212788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.212788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.213114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.213199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.213998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port a931f062-eeeb-4c6e-b429-dba949650ec9 not found, creating... [ 1505.213998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.213998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.213998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.214511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.214511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.214511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.214708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.214755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.214963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.215114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.215250] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: a931f062-eeeb-4c6e-b429-dba949650ec9 is going to be created. [ 1505.241064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.241308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.241440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.241718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.241964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.242317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.535633] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-749f5d95-ad12-4300-826e-48971f0d6f74 req-389f9851-c277-4f2a-8cc7-493e80c61d83 service neutron] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1505.535829] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-749f5d95-ad12-4300-826e-48971f0d6f74 req-389f9851-c277-4f2a-8cc7-493e80c61d83 service neutron] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1505.536053] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-749f5d95-ad12-4300-826e-48971f0d6f74 req-389f9851-c277-4f2a-8cc7-493e80c61d83 service neutron] Enqueued Resource ID: a931f062-eeeb-4c6e-b429-dba949650ec9 with Priority: HIGHEST for action port [ 1505.536292] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_rules [ 1505.536420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1505.536523] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a931f062-eeeb-4c6e-b429-dba949650ec9 with Priority: HIGHEST for action port [ 1505.537125] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.537257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.537327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.537522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.537605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.537756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.537849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.537943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.538066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.538145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.539367] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.539566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.539649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.539802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.539881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.540041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.540141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.540217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.540365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.540507] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.540600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.540660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.540793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.540885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.540946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.541971] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.542075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.542143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.542291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.542369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.542628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a931f062-eeeb-4c6e-b429-dba949650ec9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.542732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.542795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.542938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.543056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a931f062-eeeb-4c6e-b429-dba949650ec9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.557258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.560704] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.560854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.560928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.561096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.561224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.561449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.561570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.566314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.569941] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a931f062-eeeb-4c6e-b429-dba949650ec9 with status ACTIVE [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.569941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.574684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.577367] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.577512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.577582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.577771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.577860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.577978] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be created. [ 1505.615555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.615710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.615804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.616068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.616327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.628381] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: UNINITIALIZED for 2s [ 1505.810639] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 in Status: SUCCESS [ 1505.811012] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 deletion is rescheduled due to dependency. [ 1505.811012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.910571] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.910659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.910659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.910880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.910976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.911078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a931f062-eeeb-4c6e-b429-dba949650ec9 is going to be updated. [ 1505.930888] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.931060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1505.931112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1505.931307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1505.931446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1505.931606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a931f062-eeeb-4c6e-b429-dba949650ec9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.451531] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: SUCCESS [ 1506.451764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.499426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1506.499583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.501379] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: SUCCESS [ 1506.501593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.511920] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1506.512143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.514645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1506.514825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.603458] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1506.603800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.626330] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: SUCCESS [ 1506.626549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.629199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: SUCCESS [ 1506.629397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1506.651674] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1506.651907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.639744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: SUCCESS [ 1507.640186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.640421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1507.640709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1507.640995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.641152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1507.641244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1507.641595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1507.641723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.641844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.641971] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.654018] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.661368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1de9de8a-4c0a-41a7-988f-e927d9085506: rpc.has_security_group_logging(os_id): False [ 1507.680460] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.680618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1507.680691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1507.680913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1507.681004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.681249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.681352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1507.681416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1507.681577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1507.681658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.681734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be created. [ 1507.740210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.740394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1507.740394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1507.740609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1507.740805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1507.752062] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: IN_PROGRESS for 2s [ 1509.766348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: SUCCESS [ 1509.766651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1510.537525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.537715] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.539194] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.539498] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.540682] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.540987] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.542022] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.542269] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.543478] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.543478] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.544678] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.545116] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.546238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.546238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.546799] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.547141] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.547591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.547891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.071265] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-f6cffb9d-7025-4302-ad5d-77a3425ec9c8 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.071794] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.072133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.072233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.072297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.072489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.072570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.072715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.072826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.072864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.073005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.073214] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.073301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.073356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.073499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.073579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.073654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.081826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.091628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.099998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.100132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.100180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.100392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.100508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.100633] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1553.136650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.136896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.136998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.137227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.137414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.148331] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1553.281896] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-e38f763f-8d31-48cd-a046-da2121c1aca5 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.282118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.282728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.282790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.282860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.283049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.283131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.283375] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.283375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.516209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-6ad8a301-eeef-4aba-8863-ceaf18c13212 req-a041426b-5517-4d12-94c1-caa2af7e2457 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.516209] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1553.516209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.516209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1553.516209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1553.516585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1553.516585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1553.516585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.516693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1554.769098] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-3bb101b5-4f40-4a00-8173-cafd9f21cb26 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1554.769638] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1554.769955] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.770081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1554.770161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1554.770340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1554.770417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1554.770624] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.770670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.160466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1555.160700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.161217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.161453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.161636] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.161755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.161821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.161969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.162076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.162152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.164416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-5f5ce5f0-9838-4040-825d-c479836c4447 tempest-ServersTestMultiNic-118407991 tempest-ServersTestMultiNic-118407991-project-member] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1555.164828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1555.165484] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.165595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.165664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.165830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.165923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.166061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.166141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.174777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.174937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.175029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.175421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.175587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.175806] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.175951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.176019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.176199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.176296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.176404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1555.211990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.212196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.212248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.212537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.212680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.223007] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1555.532372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.532577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.532709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.532980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.533126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.533388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-521 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.533538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.533658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.533934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.534206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.534367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.534488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.534700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.534842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.535006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.535287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.535456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.535579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.535788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.535925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.536180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.536337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.536456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.536701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.536836] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2955078-2d2e-4c2d-842d-9033d2bb0ef8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.551526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.551733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.551855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.552147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.552307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.552462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port d2955078-2d2e-4c2d-842d-9033d2bb0ef8 not found, creating... [ 1555.552713] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.552876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.552998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.553218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.553358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.553643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.553803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.553925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.554133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.554271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.554414] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 is going to be created. [ 1555.577683] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.577936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.578096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.578375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.578614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.578843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.857884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-dd263b71-bff5-41ef-8e65-5720572913d9 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1555.858183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-dd263b71-bff5-41ef-8e65-5720572913d9 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1555.858306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-dd263b71-bff5-41ef-8e65-5720572913d9 service neutron] Enqueued Resource ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with Priority: HIGHEST for action port [ 1555.858522] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1555.858642] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1555.858734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with Priority: HIGHEST for action port [ 1555.859294] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.859414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.859480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.859670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.859750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.859909] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.860050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.860103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.860211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.860286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.861102] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.861201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.861263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.861407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.861482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.861618] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.861693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.861887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.861976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.862035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.862168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.862237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.862368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.862446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.862506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.862635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.862703] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2955078-2d2e-4c2d-842d-9033d2bb0ef8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.881556] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with status ACTIVE [ 1555.881756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.881878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.881946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.882137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.882222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.882385] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.882476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.882534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.882669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.882742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.884417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.884550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1555.884601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1555.884729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1555.884809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1555.884976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.885100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.255259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.255469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.255604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.255883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.256055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.256346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-55 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.256524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-55" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.256651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-55" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.256928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-55" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.257180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.257340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.257463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.257679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.257843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.257990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-55" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.258260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.258420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.258543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.258751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.258892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.259137] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.259292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.259440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.259695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.259837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae5a3ee1-d0c2-4c07-a368-d520fd1182a9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1556.280021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.280272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.280418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.280722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.280845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.281003] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 not found, creating... [ 1556.281265] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.281427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.281549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.281760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.281904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.282186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.282346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.282467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.282706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.282872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.283022] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 is going to be created. [ 1556.310539] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.310750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.310855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.311262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.311517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.311763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.397405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.397571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.397688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.398003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.398109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.398214] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 is going to be updated. [ 1556.445522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.445710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.445833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.446078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.446231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.446398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.584157] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-ed0822f5-5cec-4a18-8b88-d1af20f39614 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1556.584348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-ed0822f5-5cec-4a18-8b88-d1af20f39614 service neutron] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1556.584477] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-eee7884c-0aaf-4edd-8f53-cb135349d06c req-ed0822f5-5cec-4a18-8b88-d1af20f39614 service neutron] Enqueued Resource ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with Priority: HIGHEST for action port [ 1556.584712] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_rules [ 1556.584844] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGHEST for action security_group_members [ 1556.584943] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with Priority: HIGHEST for action port [ 1556.585548] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.585691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.585761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.585967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.586075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.586220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.586308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.586491] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.586671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.586671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.586794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.586861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.587002] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.587078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.587267] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.587791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.587850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.588173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.588288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.588419] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.588533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.588600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.588822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.588822] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae5a3ee1-d0c2-4c07-a368-d520fd1182a9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1556.607041] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with status ACTIVE [ 1556.607431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.607625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.608118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.608412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.609240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1556.609628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.609797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1556.609943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1556.610427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1556.610427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.034962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.035265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1557.035265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.035382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.035481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.035591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 is going to be updated. [ 1557.060240] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.060420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1557.060464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.060673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.060817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.060977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.235262] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1557.235741] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 deletion is rescheduled due to dependency. [ 1557.236018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.236528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.237015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.237475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.237745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1557.237951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.238263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.238508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.238722] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.247779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.257348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.269854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.270350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1557.270350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.270556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.270691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.270857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1557.307334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.307612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1557.308213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1557.308213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1557.308213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1557.328384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1559.341804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1559.341804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.349715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.358211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.365020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.365160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1559.365231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1559.365435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1559.365525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1559.365619] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1559.396729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.396883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1559.396930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1559.397262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1559.397409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1559.409656] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1561.420513] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1561.420797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1561.420887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1561.421100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1561.421287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.421398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1561.421459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1561.421598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1561.421673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1561.421760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.430328] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.438164] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.447481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.447481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1561.447481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1561.447481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1561.447481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1561.447481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1561.474382] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.474557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1561.474608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1561.474886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1561.475039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1561.485155] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1561.585882] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.585981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1563.497343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1563.497703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1563.497742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1563.497981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1563.498159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.498287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1563.498355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1563.498499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1563.498584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1563.498679] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.507591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.516307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.523178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.523341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1563.523390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1563.523566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1563.523654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1563.523745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1563.553537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.553752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1563.553752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1563.553953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1563.554170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1563.564428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1565.577500] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1565.577778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.578443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.578708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.579064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.579231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.579381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.579571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.579687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.579804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.579950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.581002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.581002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.581191] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.581329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.581436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.581637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.581706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.581821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.592760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.594357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.594793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.595079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.595378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.595591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.595871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.596157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.603130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.610617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.611049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.611290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.611624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.611851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.612096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1565.643598] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.644032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1565.644237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1565.644542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1565.644801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1565.657040] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1566.587359] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.587718] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1567.669554] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1567.669964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.670324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.670541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.670739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.670859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.670965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.671075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.671158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.671258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.671426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.671522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.671585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.671725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.671798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.671977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.672171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.672236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.672381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.672521] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.672613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.672683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.672820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.672895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.673162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.673259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.680574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1567.701758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.701985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.701985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.702170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.702289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.702559] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.702668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.702732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.702888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.702970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.703157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.703248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.703308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.703556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.703646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.703840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.703935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.704042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.704148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.704225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.704310] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1567.773747] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.773907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1567.773948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1567.774161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1567.774313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1567.788517] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1569.810309] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1569.810616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.810731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.810947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.811042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.822971] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.823156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.823156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.823312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.823429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.823646] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.823774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.823839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.824045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.824181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.824272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.824332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.824468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.824545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.824623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.824707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.832199] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.832319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.832375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.832927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.833009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.833203] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.833307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.833368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.833512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.833655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.833833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.833833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.833937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.834013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.834091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.834237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.834324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.834381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.834511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.834575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.834712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.834798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.834883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.834980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.835107] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.835191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.835249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.835376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.835445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.835519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.835600] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.841780] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1569.860581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.860750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.860792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.860999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.861089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.861291] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.861386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.861445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.861590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.861663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.861841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.861942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.862001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.862136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.862292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.862392] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.862480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.862581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.862668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.862738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.862819] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1569.927226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.927564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1569.927674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1569.928082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1569.928313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1569.944489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1571.588410] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.588804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1571.961599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1571.961788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1576.589731] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.590000] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.591025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.591025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.592176] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.592501] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.593345] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.593803] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.354981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-3e03e1a5-7963-46f1-ac37-e1ecedf1beee tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1595.355520] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1595.355864] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.356017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.356095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.356294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.356380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1595.356536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.356631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.356693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.356884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.356961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.394343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.394759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.394958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.395282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.395525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1595.395768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 already deleted. [ 1595.396062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1595.445079] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b3a0989e-798a-4999-9978-93d218c99d50 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1595.445758] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1595.446209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.446481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.446640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.446917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.447100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1595.447340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.447550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.447699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.447991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.448196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.480741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.481108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1595.481288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1595.481645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1595.481856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1595.482082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 already deleted. [ 1595.482268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1600.446833] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1600.447232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.694820] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-4d0b058a-7f00-47df-adca-619951160aea req-6fed1e35-0504-49ee-aa34-e07fe0bc1945 tempest-ServerRescueTestJSONUnderV235-997901436 tempest-ServerRescueTestJSONUnderV235-997901436-project-member] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1603.695313] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGHEST for action security_group_members [ 1603.695895] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.695895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.695895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.696180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.696180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1603.696320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.696384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.696432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.696554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.696695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.696990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.696990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.696990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.697123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1603.697123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.705369] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.705648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.705837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.706115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.706336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1603.706609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.706830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.706987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.707294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.707528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1603.707703] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be updated. [ 1603.742245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.742441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1603.742441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1603.742645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1603.742784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1603.751503] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: IN_PROGRESS for 2s [ 1604.630289] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e09ecc49-b0d9-4b9c-9218-55f4f26f82e6 req-5307c515-43fe-4221-8ea9-60afb9246676 tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1604.630929] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1604.631313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.631463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.631817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.631817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.631976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1604.632060] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.632122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.632172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.632477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.633437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.633557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.633753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.633821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.633954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1604.634060] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.652625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.652625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.652625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.653079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.653079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1604.653079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.653079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.653079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.653346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.653346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1604.653414] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be deleted. [ 1604.702488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.702839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1604.702839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1604.702916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1604.702992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1604.703083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.085632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.085824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.085977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.086252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.086410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.086705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-842 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.086862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.086981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.087193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.087433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.087581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.087696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.087899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.088092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.088251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.088502] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.088652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.088769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.089000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.089141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.089379] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.089530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.089646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.089910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.090036] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2a0d46-81d9-4147-8be4-b8c1281c3e37',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.105031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.105225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.105322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.105596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.105750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.105983] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port ff2a0d46-81d9-4147-8be4-b8c1281c3e37 not found, creating... [ 1605.106250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.106412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.106535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.106757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.106901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.107185] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.107347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.107469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.107674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.107813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.108020] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: ff2a0d46-81d9-4147-8be4-b8c1281c3e37 is going to be created. [ 1605.135514] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.135770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.135902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.136241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.136644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.136704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.454998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e09ecc49-b0d9-4b9c-9218-55f4f26f82e6 req-04e40d8b-d2e5-41e8-b3ee-dd688f759402 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1605.455168] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e09ecc49-b0d9-4b9c-9218-55f4f26f82e6 req-04e40d8b-d2e5-41e8-b3ee-dd688f759402 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1605.455310] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e09ecc49-b0d9-4b9c-9218-55f4f26f82e6 req-04e40d8b-d2e5-41e8-b3ee-dd688f759402 service neutron] Enqueued Resource ID: ff2a0d46-81d9-4147-8be4-b8c1281c3e37 with Priority: HIGHEST for action port [ 1605.455515] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1605.455634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1605.455724] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff2a0d46-81d9-4147-8be4-b8c1281c3e37 with Priority: HIGHEST for action port [ 1605.456402] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.456523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.456588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.456784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.456932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.457004] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.457092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.457150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.457286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.457355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.458224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.458321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.458382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.458526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.458598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.458733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.458820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.458880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.459145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.459332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.459436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.459499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.459649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.459726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.459810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.460607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.460704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.460770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.460915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.460989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.461126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.461213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.461270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.461462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.461462] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2a0d46-81d9-4147-8be4-b8c1281c3e37',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.473030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.487268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.487405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.487449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.487651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.487730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.487885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.487995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.491118] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.492400] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff2a0d46-81d9-4147-8be4-b8c1281c3e37 with status ACTIVE [ 1605.492570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.492677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.492741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.492917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.493000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.493449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.493449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.493449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.493449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.493705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.497871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.498058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.498112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.498274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.498368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.498468] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be created. [ 1605.534014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.534174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.534220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.534433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.534594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.544765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: UNINITIALIZED for 2s [ 1605.762457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 in Status: SUCCESS [ 1605.762815] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 deletion is rescheduled due to dependency. [ 1605.762815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.896847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.897088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.897169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.897472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.897601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.897732] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff2a0d46-81d9-4147-8be4-b8c1281c3e37 is going to be updated. [ 1605.919785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.919934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1605.920023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1605.920243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1605.920386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1605.920548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff2a0d46-81d9-4147-8be4-b8c1281c3e37" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.564447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1607.564747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.564826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.565080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.565549] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.565677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.565759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.565961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.566049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.566136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.566224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.575896] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.576155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.576266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.576501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.576629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.576832] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.576989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.577087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.577363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.577561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.577699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.577797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.578028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.578160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.578282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.578526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.578674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.578770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.578963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.579176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.579293] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.579423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.579516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.579691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.579899] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.580052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.580147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.580316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.580429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.580545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.580663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.587480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1607.605418] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.605523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.605523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.605716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.605805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.606051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.606177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.606253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.606434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.606516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.606710] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.606808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.606868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.607005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.607136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.607352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.607471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.607471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.607558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.607645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.607707] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be created. [ 1607.663794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.664024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1607.664119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1607.664334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1607.664527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1607.680559] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1609.696862] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1609.697149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1610.456411] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1610.456521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1615.457408] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.457684] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.459206] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.459556] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.460857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.461212] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.462890] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.462890] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.463927] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.464343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.464950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.465305] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.466492] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.466848] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.467819] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.468237] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1652.355043] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-05c4e0ec-ca24-40be-8a87-5d3d082b1b07 req-7e175d17-b5fb-41cb-ab1d-61c714fe876f tempest-ServerRescueTestJSON-780895511 tempest-ServerRescueTestJSON-780895511-project-member] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1652.355572] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGHEST for action security_group_members [ 1652.355904] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.356076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.356148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.356354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.356439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1652.356602] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.356696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.356758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.356901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.357078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.357178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.357178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.357315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.357393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1652.357489] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.368075] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.368203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.368274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.368445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.368531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1652.368707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.368804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.368867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.369210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.369210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1652.369210] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 is going to be updated. [ 1652.404313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.404313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1652.404313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1652.404313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1652.404313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1652.413997] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: IN_PROGRESS for 2s [ 1653.284925] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ed669cb2-6bf5-4d0a-89c4-70f084799e4e req-6115c9d3-34ab-40f3-af33-3eddae9c6480 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1653.285447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1653.285773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.285895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.285985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.286194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.286284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.286455] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.286556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.286620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.291188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.296085] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.309184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.317361] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.317520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.317590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.317798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.317887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.318064] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1653.344928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.345075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.345168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.345355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.345468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.354744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1653.646200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.646526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.646526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.646779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.647034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.647329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-733 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.647484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.647601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.647826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.648170] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.648406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.648464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.648659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.648798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.648964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.649316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.649391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.649512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.649717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.649856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.650086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-a6959b48-2398-4336-998b-f0bdcc79d00b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.650298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.650557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.650844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.651010] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6959b48-2398-4336-998b-f0bdcc79d00b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.670565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.670767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.670897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.671168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.671325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.671481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port a6959b48-2398-4336-998b-f0bdcc79d00b not found, creating... [ 1653.671729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.671885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.672016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.672244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.672385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.672662] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.672819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.672939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.673147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.673283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.673426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: a6959b48-2398-4336-998b-f0bdcc79d00b is going to be created. [ 1653.693057] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.693328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.693407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.693626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.693855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.694190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.969165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ed669cb2-6bf5-4d0a-89c4-70f084799e4e req-a481c01f-399e-4d50-b7be-5adde6801ee3 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1653.969165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ed669cb2-6bf5-4d0a-89c4-70f084799e4e req-a481c01f-399e-4d50-b7be-5adde6801ee3 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1653.969165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ed669cb2-6bf5-4d0a-89c4-70f084799e4e req-a481c01f-399e-4d50-b7be-5adde6801ee3 service neutron] Enqueued Resource ID: a6959b48-2398-4336-998b-f0bdcc79d00b with Priority: HIGHEST for action port [ 1653.969165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1653.969359] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1653.970465] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6959b48-2398-4336-998b-f0bdcc79d00b with Priority: HIGHEST for action port [ 1653.970465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.970465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.970465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.970465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.970682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.970682] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.970956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.970956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.970956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.971063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.972173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.972338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.972433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.972633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6959b48-2398-4336-998b-f0bdcc79d00b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.974591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6959b48-2398-4336-998b-f0bdcc79d00b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.990371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.990546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.990590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.990798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.991629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.991629] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.991629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.998105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6959b48-2398-4336-998b-f0bdcc79d00b with status ACTIVE [ 1653.998535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.998535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.998535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.999159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.999159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1653.999159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.999159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1653.999159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1653.999375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1653.999375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1654.395963] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.396186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1654.396186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1654.396406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1654.396497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1654.396593] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6959b48-2398-4336-998b-f0bdcc79d00b is going to be updated. [ 1654.417270] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.417421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1654.417494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1654.417706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1654.417848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1654.418110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6959b48-2398-4336-998b-f0bdcc79d00b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1654.424529] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41457c53-0beb-498e-9602-79d16e17cd73 in Status: SUCCESS [ 1654.424713] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 deletion is rescheduled due to dependency. [ 1654.424818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1655.371230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1655.371567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1655.371619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1655.371835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1655.372043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.372172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1655.372240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1655.372397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1655.372484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1655.372581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.380762] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.388865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.395748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.395967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1655.396056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1655.396257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1655.396348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1655.396444] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1655.439481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.439626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1655.439696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1655.439918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1655.440116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1655.451844] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1657.463833] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1657.464218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.464264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.464471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.464656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.464762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.464830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.464985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.465067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.465150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.465236] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.474290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.474547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.474547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.474674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.474756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.474921] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.475019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.475083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.475230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.475374] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.475529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.475529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.475666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.475743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.475830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.476022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.476128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.476382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.476382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.476458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.476574] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.476626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.476676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.476813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.476950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.477042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.477104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.477236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.477312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.477394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.477482] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.485295] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 1657.503657] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.504370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.504546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.504809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.504934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.505211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.505377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.505492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.505713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.505861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.506158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.506274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.506342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.506492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.506570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.506779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.506877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.506942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.507087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.507166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.507279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1657.569430] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.569658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1657.569658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1657.569973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1657.570196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1657.585106] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1658.970618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1658.971161] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1659.599771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1659.599771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1663.972294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1663.972654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1668.973585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1668.973865] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1673.974521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1673.975006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1678.975306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.975552] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1683.976261] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1683.976628] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1688.977070] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1688.977435] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1693.978116] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1693.978650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1698.979425] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1698.979715] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1702.953588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-c35ff189-1d3d-4afe-b155-8cdebd0b35f8 req-075ccf44-1acc-47b7-a7a7-52a560ade9ce tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1702.954138] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1702.954469] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.954659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1702.954736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1702.954957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1702.955046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1702.955236] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.955533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1702.955533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1702.955699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1702.955815] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.955920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1702.955999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1702.956154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1702.956230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1702.956329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1702.963780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1702.972372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1702.979038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.979373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1702.979474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1702.979683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1702.979814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1702.979932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1703.009350] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.009483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.009483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.009650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.009802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1703.022004] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1703.969167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7b623e03-edc8-41f3-8e5d-e96c9e2a1a33 req-d777272c-a250-4c8e-8a46-5e760e4a05a9 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 1703.969712] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 1703.969979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.970107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.970174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.970377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.970455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1703.970598] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.970700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.970744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.970933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.971068] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.971157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.971213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.971361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.971439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1703.975145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1703.981019] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.981161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.981210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.981386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.981469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1703.981649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1703.981742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1703.981802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1703.981940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1703.982012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1703.982096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 already deleted. [ 1703.982169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.237606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.237818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.237994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.238282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.238440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.238699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-207 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.238858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.238998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.239226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.239497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.239656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.239775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.239980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.240149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.240301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.240555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.240950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.241089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.241302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.241444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.241689] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-75903200-9fd7-4168-9ea8-eca1e084e9ec taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.241848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.241971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.242224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.242374] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75903200-9fd7-4168-9ea8-eca1e084e9ec',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.256371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.256537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.256668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.256897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.257043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.257195] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 75903200-9fd7-4168-9ea8-eca1e084e9ec not found, creating... [ 1704.257441] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.257598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.257718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.257925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.258143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.258431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.258591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.258711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.258917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.259124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.259296] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 75903200-9fd7-4168-9ea8-eca1e084e9ec is going to be created. [ 1704.279889] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.280128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.280178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.280425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.280662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.280882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.530889] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7b623e03-edc8-41f3-8e5d-e96c9e2a1a33 req-9cc87f73-2d60-456b-95be-30add9b1c768 service neutron] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1704.531026] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7b623e03-edc8-41f3-8e5d-e96c9e2a1a33 req-9cc87f73-2d60-456b-95be-30add9b1c768 service neutron] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 1704.531166] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7b623e03-edc8-41f3-8e5d-e96c9e2a1a33 req-9cc87f73-2d60-456b-95be-30add9b1c768 service neutron] Enqueued Resource ID: 75903200-9fd7-4168-9ea8-eca1e084e9ec with Priority: HIGHEST for action port [ 1704.531381] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_rules [ 1704.531503] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 1704.531595] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75903200-9fd7-4168-9ea8-eca1e084e9ec with Priority: HIGHEST for action port [ 1704.532188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.532308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.532374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.532569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.532649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.532801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.532891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.532950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.533090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.533165] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.533960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.535913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-75903200-9fd7-4168-9ea8-eca1e084e9ec taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.536763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.537088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.537088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.537088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75903200-9fd7-4168-9ea8-eca1e084e9ec',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.543694] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.561038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1704.563198] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75903200-9fd7-4168-9ea8-eca1e084e9ec with status ACTIVE [ 1704.563421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.563523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.563591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.563907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.563907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.564094] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.564202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.564267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.564419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.564496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.565678] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.565790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.565865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.566027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.566106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.566300] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.566423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.568252] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.568356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.568430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.568587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.568668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.568758] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be created. [ 1704.884386] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.884630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.884630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.884774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.884865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.884961] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75903200-9fd7-4168-9ea8-eca1e084e9ec is going to be updated. [ 1704.921383] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1704.921671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1704.921671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1704.921953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1704.922078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1704.922258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75903200-9fd7-4168-9ea8-eca1e084e9ec" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1705.037675] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1705.038025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1705.414511] neutron-nsxv3-agent[62156]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'data': {'id': 'fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'display_name': 'fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'path': '/infra/domains/default/groups/fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'expression': [{'value': 'security_group|fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.12']}], 'tags': [{'scope': 'age', 'tag': 1707211517}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1705.414885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=62156) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1707.446510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1707.446918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1707.446918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1707.447416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1707.447668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1707.456603] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: UNINITIALIZED for 2s [ 1709.467545] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: SUCCESS [ 1709.467849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.467897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1709.468177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1709.468368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.468480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1709.468544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1709.468692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1709.468771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.468853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.468961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.478665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.484720] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf69e81-3cbd-4cd2-b99e-b75388d904b7: rpc.has_security_group_logging(os_id): False [ 1709.501930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.502133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1709.502133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1709.503390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.503390] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be created. [ 1709.532430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1709.532598] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1709.558879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.559157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1709.559276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1709.559553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1709.559801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1709.572906] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: IN_PROGRESS for 2s [ 1709.826864] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1709.827005] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:5 started [ 1711.587085] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: SUCCESS [ 1711.587085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1714.534199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1714.534542] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1719.535896] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1719.536203] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1724.536783] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1724.537144] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1729.537647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1729.537913] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1734.539369] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1734.539706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1739.540647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1739.540647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1741.709025] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.709344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1741.709344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1741.709569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1741.709657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1741.709843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.709941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1741.710003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1741.710144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1741.710252] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1741.718829] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1741.726034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1741.731601] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1741.731729] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1742.342086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.342279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.342279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.342497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.353549] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1742.353995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.355055] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1742.401260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.401485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.401485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.401670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.414694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.415490] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:3. [ 1742.415622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'4dc9db0a-49f6-4e5b-a7e2-5892377bf947', '8f6455c3-c7c4-4dd1-94e2-f1852b977dae', '845ccfbb-6548-4e7e-93b1-29398df50be6'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1742.415761] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1742.442487] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.442750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.442750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.442887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.443441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.443576] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1742.484666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.484940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.484940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.485074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.485338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.485527] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1742.532160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.532430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.532430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.532573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.532763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.532950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:12. [ 1742.533034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'41457c53-0beb-498e-9602-79d16e17cd73', '518a0bec-8c5a-406d-bdb3-ca7657d7078f', 'fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'a7ab204b-f602-43f2-b825-e60a546adb0f', 'e0033677-0a6e-4486-8a4a-fa6c2b550528', '9014b003-e476-4ebb-b600-3ffb812c8241', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', '1de9de8a-4c0a-41a7-988f-e927d9085506', '18832a39-e87e-45f8-beda-f4a5d65556d4', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1742.533139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1742.549511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.549737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.549737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.549882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.549973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.550086] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1742.550152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1742.550211] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1742.599499] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.599773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.599773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.599911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.600382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.600547] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1742.600641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1742.600714] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1742.600773] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 3/3 resources of Type:Ports [ 1742.600828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dc9db0a-49f6-4e5b-a7e2-5892377bf947 with Priority: HIGH for action port [ 1742.600893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f6455c3-c7c4-4dd1-94e2-f1852b977dae with Priority: HIGH for action port [ 1742.600957] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 845ccfbb-6548-4e7e-93b1-29398df50be6 with Priority: HIGH for action port [ 1742.601018] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 12/12 resources of Type:Security Group Rules [ 1742.601127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_rules [ 1742.601127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1742.601240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 1742.601240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1742.601353] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1742.601353] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1742.601462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1742.601462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1742.601573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 1742.601573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1742.601704] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1742.601704] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 1742.601810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1742.601810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1742.601942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.602031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.602088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.602243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.602320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.602487] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.602577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.602633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.602764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.602844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.602991] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.603082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.603140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.603263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.603335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.603496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.603583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.603640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.603763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.603827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.603993] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.604117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.604177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.604270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.604362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.604495] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.604578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.604634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.604756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.604827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.604984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.605073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.605128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.605255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.605317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.605477] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.605562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.605618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.605741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.605811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.605966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.606069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.606128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.606254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.606316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.606480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.606567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.606622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.606746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.606816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.606974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.607063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.607119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.607242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.607311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.607474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.607553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.607611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.607786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.607876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.608110] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.608210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.608267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.608388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.608465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.608614] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.608702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.608759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.608884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.608949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.609208] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.609307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.609366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.609498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.609570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.609741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.609855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.609936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.610013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.610088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.610215] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.610341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.610410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.610487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.610558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.610718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.610797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.610854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.610978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.611050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.611212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.611290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.611346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.611468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.611529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.611689] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.611774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.611831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.611953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.612036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.612200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.612287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.612343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.612467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.612533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.612690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.612779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.612835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.612957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.613028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.613187] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.613265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.613321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.613445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.613512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.613669] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.613754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.613810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.613932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.614002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.614163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.614248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.614305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.614439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.614508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.614667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.614753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.614809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.614931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.615002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.615163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.615250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.615306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.615429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.615498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.615659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.615744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.615799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.615925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.616034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.616196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.616287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.616343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.616472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.616542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.616693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.616769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.616825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.616949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.617020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.617178] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.617264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1742.617320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1742.617441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1742.617511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1742.617608] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:17 [ 1742.617669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 5 of least updated resources [ 1742.617734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 with Priority: HIGH for action port [ 1742.617814] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with Priority: HIGH for action port [ 1742.617883] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34015933-cffc-43a3-a4bf-69cebe879507 with Priority: HIGH for action port [ 1742.617947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80131c19-baa0-4896-9681-6b5a4d061684 with Priority: HIGH for action port [ 1742.618032] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with Priority: HIGH for action port [ 1742.618131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.541771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1744.542042] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1744.542042] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc9db0a-49f6-4e5b-a7e2-5892377bf947 with Priority: HIGH for action port [ 1744.542136] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845ccfbb-6548-4e7e-93b1-29398df50be6 with Priority: HIGH for action port [ 1744.542868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1744.543003] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 1744.543105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with Priority: HIGH for action port [ 1744.543271] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80131c19-baa0-4896-9681-6b5a4d061684 with Priority: HIGH for action port [ 1744.543398] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34015933-cffc-43a3-a4bf-69cebe879507 with Priority: HIGH for action port [ 1744.543494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with Priority: HIGH for action port [ 1744.543586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1744.543675] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 with Priority: HIGH for action port [ 1744.543763] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1744.543850] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 1744.543936] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1744.544050] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1744.544152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1744.544240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 1744.544327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_rules [ 1744.544414] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1744.544500] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f6455c3-c7c4-4dd1-94e2-f1852b977dae with Priority: HIGH for action port [ 1744.544586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_rules [ 1744.544920] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.545046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.545114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.545318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.545400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.545559] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc9db0a-49f6-4e5b-a7e2-5892377bf947 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.545652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc9db0a-49f6-4e5b-a7e2-5892377bf947" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.545709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc9db0a-49f6-4e5b-a7e2-5892377bf947" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.545898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc9db0a-49f6-4e5b-a7e2-5892377bf947" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.545972] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc9db0a-49f6-4e5b-a7e2-5892377bf947',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.546475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.546581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.546647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.546790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.546864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.547000] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-845ccfbb-6548-4e7e-93b1-29398df50be6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.547088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-845ccfbb-6548-4e7e-93b1-29398df50be6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.547149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-845ccfbb-6548-4e7e-93b1-29398df50be6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.547313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-845ccfbb-6548-4e7e-93b1-29398df50be6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.547385] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('845ccfbb-6548-4e7e-93b1-29398df50be6',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.547805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.547909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.548020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.548164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.548242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.548381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.548471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.548531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.548666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.548736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.549084] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.549183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.549245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.549384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.549457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.549592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.549680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.549740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.549899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.549969] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.550313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.550420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.550485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.550710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.550789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.550927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.551019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.551081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.551216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.551282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9f5b9f-61fc-44d8-8dac-fd3773a35ace',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.551613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.551711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.551774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.551912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.551985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.552132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-80131c19-baa0-4896-9681-6b5a4d061684 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.552220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.552279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.552411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.552478] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80131c19-baa0-4896-9681-6b5a4d061684',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.552810] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.552907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.552970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.553111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.553181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.553314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-34015933-cffc-43a3-a4bf-69cebe879507 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.553401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.553459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.553589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.553655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34015933-cffc-43a3-a4bf-69cebe879507',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.553985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.554084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.554147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.554283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.554354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.554486] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.554573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.554632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.554761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.554829] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.555259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.555362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.555427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.555563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.555638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.555771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.555861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.555920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.556062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.556131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.556466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.556565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.556626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.556764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.556835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.556979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e02792-762e-43fb-88ac-ed1f53e7aa90 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.557043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.557104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.557239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.557306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e02792-762e-43fb-88ac-ed1f53e7aa90',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.557644] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.557741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.557805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.557942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.558031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.558171] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.558260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.558319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.558474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.558542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.558879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.558994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.559064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.559202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.559275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.559412] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.559500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.559560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.559689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.559756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.560129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.560231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.560295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.560434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.560507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.560707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.560810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.560871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.561010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.561081] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.561420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.561519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.561582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.561718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.561791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.561924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.562013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.562073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.562206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.562273] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.562606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.562704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.562766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.562902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.562976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.563111] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.563198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.563259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.563390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.563459] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.563796] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.563896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.563959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.564111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.564185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.564321] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.564409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.564467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.564597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.564664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.565001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.565103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.565166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.565304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.565377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.565513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.565601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.565662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.565794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.565862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.566287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.566390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.566452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.566588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.566661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.566797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.566886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.566945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.567091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.567159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.567504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.567601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.567664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.567804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.567878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.568099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f6455c3-c7c4-4dd1-94e2-f1852b977dae taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.568197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f6455c3-c7c4-4dd1-94e2-f1852b977dae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.568197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f6455c3-c7c4-4dd1-94e2-f1852b977dae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.568352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f6455c3-c7c4-4dd1-94e2-f1852b977dae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.568422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f6455c3-c7c4-4dd1-94e2-f1852b977dae',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.568773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.568873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.568937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.569104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.569181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.569342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.569437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.569498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.569632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.569699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.710880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dc9db0a-49f6-4e5b-a7e2-5892377bf947 [ 1744.711096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.711096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.711293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.711355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.711423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.712590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 845ccfbb-6548-4e7e-93b1-29398df50be6 [ 1744.712797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.712896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.712963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.713497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.713497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.714171] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.714299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.714376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.714530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.714737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.714827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.714919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.714919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.715116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.715199] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.715285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.715354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.715516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.715581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.715661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.715731] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.716489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f6455c3-c7c4-4dd1-94e2-f1852b977dae [ 1744.716661] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.716765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.716830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.716969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.717050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.717961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.718111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.718182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.718324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.718400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.718543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.718643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.718711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.718825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.718970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.719067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.719140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.719306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.719383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.719463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.719532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.738685] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.738871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.738955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.739119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.739207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.739402] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.739518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.739597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.739723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.739869] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.739958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.740030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.740205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.740285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.740364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.740448] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.741652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.741788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.741856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.741955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.742075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.742235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.742352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.742419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.742557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.742697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.742790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.742943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.743125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.743204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.743285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.743358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.749500] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.749637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.749694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.749860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.749939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.750083] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.750169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.750243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.750366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.750501] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.750592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.750641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.750776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.750849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.750929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.751007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.751717] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.751813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.751880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.752037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.752114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.752262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.752349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.752414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.752596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.752662] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.752742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.752801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.752926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.753107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.753205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.753277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.753997] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.754106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.754177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.754334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.754407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.754552] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.754648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.754714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.754879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.755020] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.755130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.755198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.755343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.755443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.755502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.755570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.760051] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.760191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.760264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.760428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.760510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.760658] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.760752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.760816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.760949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.761090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.761185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.761246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.761404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.761486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.761569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.761644] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.768115] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace with status ACTIVE [ 1744.768308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.768418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.768481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.768662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.768748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.768922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.769029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.769105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.769233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.769316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.784279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.784497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.784497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.784659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.830034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.830318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.844483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.844757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.844757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.845044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.845150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.845349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.845477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.845548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.845706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.845861] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.845977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.846039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.846178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.846258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.846344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.846431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.851854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.852056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.852056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.852215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.852286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.852441] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.852528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.852590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.852725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.852881] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.852957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.853023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.853138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.853239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.853324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.853411] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.855278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.855396] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be deleted. [ 1744.856551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.856725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.858333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 with status ACTIVE [ 1744.858509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.858615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.858677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.858818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.858900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.859089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.859272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.859272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.859395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.859453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.863376] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17e02792-762e-43fb-88ac-ed1f53e7aa90 with status ACTIVE [ 1744.863545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.863657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.863722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.863877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.863959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.864143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.864237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.864296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.864431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.864508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.865739] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.865872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.865973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.866138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.866221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.866364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.866455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.866515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.866651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.866791] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.866882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.866943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.867069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.867146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.867227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.867408] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.867490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.867556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.867675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.867749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.867888] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.867975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.868087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.868238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.868380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.868468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.868527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.868651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.868751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.868833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.868917] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.872610] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34015933-cffc-43a3-a4bf-69cebe879507 with status ACTIVE [ 1744.872848] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.872915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.872973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.873093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.873178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.873342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.873438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.873496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.873635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.873712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.874780] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80131c19-baa0-4896-9681-6b5a4d061684 with status ACTIVE [ 1744.874940] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.875044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.875103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.875254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.875333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.875634] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.875734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.875792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.875951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.876062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.877192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.877306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.877370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.877538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.877620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.877765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.877878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.877944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.878134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.878300] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.878401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.878462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.878600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.878697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.878783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.878935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.879069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.879146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.879303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.879416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.879519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.879614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.879676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.879801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.879939] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.880052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.880112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.880270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.880372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.880458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.880547] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.881448] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.882350] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.882475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.882543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.882688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.882777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.882913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.883009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.883076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.883192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.883334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.883418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.883479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.883609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.883686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.883827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.883908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.884024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.884097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.884229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.884307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.884449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.884546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.884618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.884721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.884858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.884950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.885041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.885175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.885255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.885336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.885416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.892844] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.893070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.893070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.893251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.893320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.893459] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.893558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.893615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.893768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.893910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.894000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.894076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.894193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.894275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.894492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.894588] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.894674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.894734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.894855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.894928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.895069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.895161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.895221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.895348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.895528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.895636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.895636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.895971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.896073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.896185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.896303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.897179] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.897302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.897367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.897532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.897612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.897762] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.897864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.897926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.898067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.898215] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.898334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.898394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.898567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.898627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.898684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.898819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.898911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.898986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.899457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.899457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.899457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.899457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.899827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.899827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.899827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.899827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.900169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.900169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.900169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.900421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.900421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.901157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.901312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.901312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.901476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.901583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.901746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.901857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.901959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.902094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.902241] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.902330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.902389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.902532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.902608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.902689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.902931] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.902931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.903070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.903138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.903225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.903377] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.903486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.903558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.903648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.903784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.903866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.903925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.904080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.904162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.904242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.904326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.905151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.906008] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.906775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.906887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.906962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.907097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.907243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.907358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.907460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.907521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.907663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.907809] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.907898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.907958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.908169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.908250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.908333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.908486] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.908580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.908640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.908773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.908846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.909010] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.909119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.909181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.909292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.909432] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.909522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.909582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.909709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.909784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.909856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.909928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.915950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 1744.918062] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 1744.919460] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ab204b-f602-43f2-b825-e60a546adb0f: rpc.has_security_group_logging(os_id): False [ 1744.920631] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18832a39-e87e-45f8-beda-f4a5d65556d4: rpc.has_security_group_logging(os_id): False [ 1744.921741] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 1744.922903] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9014b003-e476-4ebb-b600-3ffb812c8241: rpc.has_security_group_logging(os_id): False [ 1744.931989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.932197] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41457c53-0beb-498e-9602-79d16e17cd73 is going to be deleted. [ 1744.935604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.935799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.935799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.935997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.936190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.936244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-845ccfbb-6548-4e7e-93b1-29398df50be6" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.936592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1744.937535] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1744.938905] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1de9de8a-4c0a-41a7-988f-e927d9085506: rpc.has_security_group_logging(os_id): False [ 1744.940249] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf69e81-3cbd-4cd2-b99e-b75388d904b7: rpc.has_security_group_logging(os_id): False [ 1744.944534] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.944701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.944781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.945020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.945131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.945283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc9db0a-49f6-4e5b-a7e2-5892377bf947" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.945985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.946097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.946159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.946326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1744.946410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.946703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f6455c3-c7c4-4dd1-94e2-f1852b977dae" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1744.999130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.999449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1744.999449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1744.999684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.001472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.001633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.002246] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.002341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.003033] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.003130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.004205] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.004349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.011266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.011492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.015185] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.015371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.049662] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.049662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.071545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.071703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.072528] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1745.072976] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.073078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.073705] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1745.074089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.074217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.104046] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1745.104046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.104046] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.104046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.104046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.104527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.104527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.104527] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.104527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.104527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.104939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.104939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.104939] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.105113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.105113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.105224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.105274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.105326] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be updated. [ 1745.107243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.107401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.167304] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.167521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.184543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.184866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.184973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.185044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.185256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.185342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.185429] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be updated. [ 1745.186711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.186911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.232643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.233105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.233105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.233105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.233105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1745.233265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.233401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.267329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.267423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.317122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.317416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.317537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.317600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.317892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.317892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.318233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.318358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.318426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.318594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.318674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.318883] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.319092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.319261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.319437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.319522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.319624] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1745.320788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.320948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.321032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.321151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.321281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.321422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.346874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.347198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.370116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.370437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.370538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.370621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.370932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.371066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.371066] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be updated. [ 1745.372290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.372481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.381629] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.381906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.451854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.452180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.452306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.452377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.452582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.452669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.452868] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.452973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.453126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.453394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.453539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.453768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.453919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.453969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.454115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.454196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.454293] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1745.455531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.455702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.455791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.456071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.456231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.456399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.523683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.523683] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.523683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.523683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.523898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.523898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.524056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.524164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.524299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.524377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.524455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.524639] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.524737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.524775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.524906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.524984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.525078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1745.526252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.526418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.526566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.527536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.527693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.568992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.569362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.575487] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.575627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.579243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: IN_PROGRESS for 2s [ 1745.583424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.583688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.583811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.583881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.584099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.584186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.584596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.584725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.584796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.584973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.585061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.585259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.585345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.585410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.585566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.585647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.585746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1745.586864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.587033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.632775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.633069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.653844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.654141] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.654274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.654343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.654553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.654639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.654840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.654942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.655006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.655151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.655228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.655419] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.655500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.655562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.655700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.655779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.655880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1745.657118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.657297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.660138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.660138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.714158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.714458] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.714582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.714642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.714822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.714903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.714998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be updated. [ 1745.716210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.716379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.716523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.717507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.717659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.717789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.718719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.718888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.719030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.719901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.720410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.720559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.721806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.721967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.722163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.723244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.723399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.723530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.745100] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.745277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.745321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.745530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.745686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.782552] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1745.785261] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1745.785999] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: IN_PROGRESS for 2s [ 1745.787302] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: IN_PROGRESS for 2s [ 1745.788163] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1745.792721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1745.814755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1745.859001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.859242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.859242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.859430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.859583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.864972] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1745.865168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1745.865168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1745.865370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1745.865522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1745.886924] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: IN_PROGRESS for 2s [ 1745.902707] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1745.903363] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1747.029402] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1747.029952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.030186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.030186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.030406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.030495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.030575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34015933-cffc-43a3-a4bf-69cebe879507 is going to be updated. [ 1747.032576] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.032723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.032778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.032941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.034778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.034778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80131c19-baa0-4896-9681-6b5a4d061684 is going to be updated. [ 1747.043364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.043364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.043805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.044499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.045084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.045305] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a9f5b9f-61fc-44d8-8dac-fd3773a35ace is going to be updated. [ 1747.048730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.049006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.049090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.049412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.049540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.049667] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521 is going to be updated. [ 1747.053804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.054017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.054085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.054376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.054523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.054668] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17e02792-762e-43fb-88ac-ed1f53e7aa90 is going to be updated. [ 1747.075022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.075343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.075343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.075479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.075587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.075759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34015933-cffc-43a3-a4bf-69cebe879507" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.076606] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1747.077096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.077307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.077307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.077526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.077664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.077817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80131c19-baa0-4896-9681-6b5a4d061684" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.082451] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1747.082970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.083195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.083195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.083373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.083444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.083584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d13dd7fc-9b6f-4bef-81ab-0e97ac5c8521" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.084300] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1747.084731] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.084882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.084955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.085123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.085188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.085297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e02792-762e-43fb-88ac-ed1f53e7aa90" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.085905] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1747.086271] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.086395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1747.086486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1747.086629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1747.086718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.086819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a9f5b9f-61fc-44d8-8dac-fd3773a35ace" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.591175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: SUCCESS [ 1747.591425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.801571] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1747.801814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.802565] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: SUCCESS [ 1747.802800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.803460] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 1747.803703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.804347] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1747.805388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.807525] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: SUCCESS [ 1747.807701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.810363] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1747.810579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.825354] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1747.825624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.900496] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: SUCCESS [ 1747.900863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1747.912431] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1747.912714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1749.546189] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1749.546497] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1752.101105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e2749e1d-456c-4dd8-93cb-2ff052264a7c req-afffd807-122c-4e3b-b4e0-fa78fdfc426a tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1752.101105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGHEST for action security_group_members [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1752.101105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.111535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.111681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.111732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.112382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.112483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1752.112665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.112765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.112828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.112974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.113054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1752.113181] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be updated. [ 1752.144168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.144168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1752.144926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1752.144926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1752.144926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1752.155602] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: IN_PROGRESS for 2s [ 1753.200274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-a0ad1f9a-2301-4990-ae21-654f6d1df540 req-023cc0fd-ffe9-44aa-99eb-22938c865be6 tempest-SecurityGroupsTestJSON-1742011264 tempest-SecurityGroupsTestJSON-1742011264-project-member] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1753.200822] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1753.201150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.201279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.201374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.201550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.201637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.201796] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.201895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.201959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.202109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.202253] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.202347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.202410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.202551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.202631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.202717] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.211456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.222431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.230155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.230328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.230377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.230579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.230666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.230763] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1753.259577] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.259720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.259794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.259995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.260163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.269127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1753.525718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.525954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.526164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.526437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.526581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.526837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-685 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.526994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.527117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.527341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.527572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.527723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.527847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.528211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.528451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.528672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-685" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.529093] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.529339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.529503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.529740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.529884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.530133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-80490b79-8e18-4406-be0e-d2bdfa514b4c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.530353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.530496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.530757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.530900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80490b79-8e18-4406-be0e-d2bdfa514b4c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.546449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.547045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.547431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.547956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.548466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.548883] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 80490b79-8e18-4406-be0e-d2bdfa514b4c not found, creating... [ 1753.549442] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.549875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.550235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.550746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.551022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.551456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.551791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.552055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.552388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.552641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.552893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 80490b79-8e18-4406-be0e-d2bdfa514b4c is going to be created. [ 1753.574641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.575102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.575388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.575748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.576153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.576501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.802936] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-a0ad1f9a-2301-4990-ae21-654f6d1df540 req-431a8d4d-e0c0-4830-9ced-8f0001d7f3d9 service neutron] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_rules [ 1753.803976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-a0ad1f9a-2301-4990-ae21-654f6d1df540 req-431a8d4d-e0c0-4830-9ced-8f0001d7f3d9 service neutron] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1753.803976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-a0ad1f9a-2301-4990-ae21-654f6d1df540 req-431a8d4d-e0c0-4830-9ced-8f0001d7f3d9 service neutron] Enqueued Resource ID: 80490b79-8e18-4406-be0e-d2bdfa514b4c with Priority: HIGHEST for action port [ 1753.803976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_rules [ 1753.803976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1753.803976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80490b79-8e18-4406-be0e-d2bdfa514b4c with Priority: HIGHEST for action port [ 1753.804308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.804383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.804383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.804597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.804683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.804839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.804937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.805023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.805151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.805227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.806099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.806207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.806275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.806426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.806504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.806748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.806748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.806908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.807001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.807064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.807363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.807363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.807431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-80490b79-8e18-4406-be0e-d2bdfa514b4c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.807488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.807528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.807656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.807728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80490b79-8e18-4406-be0e-d2bdfa514b4c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1753.831659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.831868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.831868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.832048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.832137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.832304] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.832383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.844991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80490b79-8e18-4406-be0e-d2bdfa514b4c with status ACTIVE [ 1753.845253] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.845409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.845499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.845725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.845842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1753.846061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1753.846199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1753.846281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1753.846462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1753.846567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1754.172251] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 in Status: SUCCESS [ 1754.172427] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 deletion is rescheduled due to dependency. [ 1754.172543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1754.300186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.300581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1754.300581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1754.300659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1754.300728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1754.300872] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80490b79-8e18-4406-be0e-d2bdfa514b4c is going to be updated. [ 1754.322668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.322904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1754.322904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1754.323078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1754.323283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1754.323490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80490b79-8e18-4406-be0e-d2bdfa514b4c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1755.280403] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1755.280688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1755.280867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1755.281088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1755.281283] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.281402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1755.281469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1755.281620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1755.281723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1755.281817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.289779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.298553] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.308347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.308656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1755.308656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1755.308800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1755.308844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1755.308913] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1755.340428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.340605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1755.340649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1755.340832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1755.340980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1755.350588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1756.008342] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-05adc40f-3e63-46e4-8747-049c6d54a49d tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1756.008867] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1756.009225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.009352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.009421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.009628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.009710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1756.009869] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.009964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.010024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.010230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.010313] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1756.046598] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.046762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.046812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.047010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.047094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1756.047187] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 already deleted. [ 1756.047268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1756.111377] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-6d7ccad9-7f92-4f28-a459-54fc67b97e41 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1756.111917] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1756.112251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.112379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.112440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.112637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.112722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1756.112875] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.112972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.113086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.113290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.113366] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1756.147742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1756.147900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1756.147962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1756.148204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1756.148315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1756.148451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 already deleted. [ 1756.148562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.363663] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1757.363663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.363963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.364095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.364322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.364489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.364489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.364659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.364775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.364949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.365181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1757.375866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.376283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.376468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.376755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.376945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.377206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.377437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.377601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.377853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.378557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.378842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.379086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.379356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.379542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.379712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.379954] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.380291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.380451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.380819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.380997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.381233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.381466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.381619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.381847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.382087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.382302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.382482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.382729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.382910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.383087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.383272] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1757.390660] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ab204b-f602-43f2-b825-e60a546adb0f: rpc.has_security_group_logging(os_id): False [ 1757.409873] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.410394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.410659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.411085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.411376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.411866] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.412304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.412557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.412867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.412956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.413181] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.413277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.413342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.413516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.413590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.413911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.414030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.414090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.414247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.414320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.414416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1757.479714] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.479907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1757.479963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1757.480153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1757.480363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1757.494744] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1759.510375] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1759.510746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1761.113374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1761.113705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1766.115091] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1766.115448] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1771.116025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1771.116025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1776.117304] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1776.117304] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1781.117829] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1781.118187] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1786.119364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1786.119739] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1791.120903] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1791.121118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1796.121811] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1796.122185] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1798.723697] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-d48e52e1-3bcb-43fa-843a-c4e80e468b04 req-117a76d1-1a59-42ab-908a-00c5a400e6c4 tempest-SecurityGroupsTestJSON-1742011264 tempest-SecurityGroupsTestJSON-1742011264-project-member] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1798.723697] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1798.723697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1798.732492] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1798.747776] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1798.759315] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.759315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1798.759315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1798.759315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1798.759315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1798.759315] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1798.791408] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1798.793474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1798.793600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1798.793831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1798.793988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1798.804794] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1799.731605] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-5112e606-af69-46ff-9e69-59dee92ef2b6 req-9cbfa5d7-2dae-4753-a015-cdf2ed4a7db9 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1799.731942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1799.732262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.732391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1799.732460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1799.732657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1799.732779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1799.732879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.732975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1799.733038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1799.733187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1799.733324] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.733430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1799.733466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1799.733588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1799.733661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1799.733742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.742668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.750767] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.758390] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.758538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1799.758587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1799.758902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1799.758902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1799.759082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1799.790907] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.791053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1799.791133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1799.791317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1799.791463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1799.803112] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1800.097801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.098065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.098219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.098498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.098647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.098909] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-445 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.099195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.099282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.099475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.099728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.099889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.099999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.100248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.100409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.100564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.100821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.100986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.101097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.101307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.101444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.101684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.101851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.101958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.102218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.102362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6dd0106-ce5f-4edf-b41d-0d83b8ed4527',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.117790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.118313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.118313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.118641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.118641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.118880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 not found, creating... [ 1800.118982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.119165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.119287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.119586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.119717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.120061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.120239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.120407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.120734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.120972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.121210] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 is going to be created. [ 1800.143803] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.144080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.144242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.144502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.144751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.144992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.450389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-5112e606-af69-46ff-9e69-59dee92ef2b6 req-01e43324-ed77-40a3-894f-3b290818c754 service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 1800.450497] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-5112e606-af69-46ff-9e69-59dee92ef2b6 req-01e43324-ed77-40a3-894f-3b290818c754 service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1800.450664] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-5112e606-af69-46ff-9e69-59dee92ef2b6 req-01e43324-ed77-40a3-894f-3b290818c754 service neutron] Enqueued Resource ID: b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 with Priority: HIGHEST for action port [ 1800.451188] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 1800.451327] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1800.451425] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 with Priority: HIGHEST for action port [ 1800.451705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.451828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.451898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.452132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.452197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.452340] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.452433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.452498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.452641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.452718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.453527] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.453636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.453706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.454034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.454034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.454134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.454134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.454319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.454414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.454556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.454616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.454704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.454804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.454885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.454949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.455075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.455154] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6dd0106-ce5f-4edf-b41d-0d83b8ed4527',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.472367] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.472538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.472600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.472779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.472860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.473027] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.473117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.478043] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 with status ACTIVE [ 1800.478245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.478372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.478433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.478633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.478719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.478886] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.478982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.479731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.479950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.480082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.826447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1800.826727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.845145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.845329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.845370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.845572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.845663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.845761] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6dd0106-ce5f-4edf-b41d-0d83b8ed4527 is going to be updated. [ 1800.869225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.869397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1800.869561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1800.869724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1800.869889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1800.870081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6dd0106-ce5f-4edf-b41d-0d83b8ed4527" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1801.813330] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1801.813561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1801.813735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1801.813948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1801.814134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.814253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1801.814320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1801.814472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1801.814558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1801.814652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.828910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.838446] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1801.847651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.847838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1801.847918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1801.848183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1801.848276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1801.848373] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1801.877509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1801.877509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1801.877509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1801.877721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1801.877879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1801.887451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1803.899210] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1803.899530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.899593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.899795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.899984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.900115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.900185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.900352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.900452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.900540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.900633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1803.910276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.910344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.910417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.910601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.910686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.910856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.910959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.911012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.911159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.911300] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.911392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.911454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.911589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.911669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.911753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.911901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.911991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.912122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.912200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.912272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.912416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.912497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.912554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.912686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.912823] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.912903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.912964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.913095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.913173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.913252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.913339] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1803.920770] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 1803.938288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.938459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.938499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.938682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.938773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.939002] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.939135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.939216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.939477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.939560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.939756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.939847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.939907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.940059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.940134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.940325] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.940415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.940477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.940613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.940686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1803.940768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1803.998556] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1803.998771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1803.998771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1803.998962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1803.999125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1804.013928] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1805.453891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1805.453891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1806.027900] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1806.028255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1810.454917] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1810.455289] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1815.456383] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1815.456599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1820.457562] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1820.457942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1825.458713] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1825.458987] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1830.459991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1830.460289] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1835.461046] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1835.461046] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1840.461822] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1840.462193] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1845.463192] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1845.463512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1847.254831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ca882aac-9d98-485b-bc8d-4d0b65396ae6 req-99a60dd8-5fe2-4667-9841-65d2d805c59e tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1847.255349] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 1847.255670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.255801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1847.255870] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1847.256147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1847.256264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1847.256452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.256559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1847.256701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1847.256835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1847.257012] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.257136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1847.257202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1847.257368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1847.257476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1847.257668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.265287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.272719] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1847.279975] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.280134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1847.280211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1847.280398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1847.280489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1847.280583] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1847.311978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1847.312197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1847.312267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1847.312634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1847.312708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1847.322970] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1848.337778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b98fa270-ddce-4186-a57d-f8ff965b8ae9 req-6dfa1886-4f83-49a5-84be-15638f738c38 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 1848.338398] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 1848.338685] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.338804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.338873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.339134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.339259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.339352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.339475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.339539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.339690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.339834] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.339915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.339971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.340137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.340203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.340303] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1848.362319] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.362481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.362625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.362762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.362805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.363010] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.363115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.363161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.363322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.363401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.363489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 already deleted. [ 1848.363569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.699200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.699446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.699575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.699843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.699990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.700271] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-467 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.700421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.700538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.700743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.700995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.701156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.701272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.701475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.701613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.701761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-467" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.702046] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.702198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.702314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.702515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.702645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.702882] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-341691f6-6d0f-417c-805a-c5465b2c6f84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.703030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.703146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.703398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.703532] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341691f6-6d0f-417c-805a-c5465b2c6f84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1848.718503] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.718773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.718969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.719281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.719488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.719689] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 341691f6-6d0f-417c-805a-c5465b2c6f84 not found, creating... [ 1848.719992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.720234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.720406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.720675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.720898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.721230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.721452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.721620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.721876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.722080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.722273] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 341691f6-6d0f-417c-805a-c5465b2c6f84 is going to be created. [ 1848.742974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1848.746257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1848.746532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1848.746859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1848.747453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1848.748098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.064241] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b98fa270-ddce-4186-a57d-f8ff965b8ae9 req-4b2b3b57-be20-46ad-87b6-dc00c4812811 service neutron] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1849.064429] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b98fa270-ddce-4186-a57d-f8ff965b8ae9 req-4b2b3b57-be20-46ad-87b6-dc00c4812811 service neutron] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 1849.064576] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b98fa270-ddce-4186-a57d-f8ff965b8ae9 req-4b2b3b57-be20-46ad-87b6-dc00c4812811 service neutron] Enqueued Resource ID: 341691f6-6d0f-417c-805a-c5465b2c6f84 with Priority: HIGHEST for action port [ 1849.064795] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_rules [ 1849.064920] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 1849.065014] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341691f6-6d0f-417c-805a-c5465b2c6f84 with Priority: HIGHEST for action port [ 1849.065563] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.065710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.065742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.065946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.066132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.066194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.066292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.066354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.066505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.066579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.067399] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.067507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.067575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.067724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.067801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.067945] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.068210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.068352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.068527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.068699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.068821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.068902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.069221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.069337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.069465] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.070481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.070633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.070727] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.070901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.071008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.071179] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-341691f6-6d0f-417c-805a-c5465b2c6f84 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.071304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.071388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.071553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.071663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341691f6-6d0f-417c-805a-c5465b2c6f84',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.094088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.099707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.099907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.100014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.100270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.100405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.100601] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.100732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.105557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1849.113308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 341691f6-6d0f-417c-805a-c5465b2c6f84 with status ACTIVE [ 1849.113557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.113731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.113826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.114110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.114215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.114429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.114563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.114648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.114826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.114935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.116874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.117059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.117132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.117327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.117451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.117573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be created. [ 1849.159107] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.159339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.159440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.159688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.159892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.169392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: UNINITIALIZED for 2s [ 1849.333817] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1849.334063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.453793] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.454129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.454129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.454234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.454333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.454449] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 341691f6-6d0f-417c-805a-c5465b2c6f84 is going to be updated. [ 1849.473395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1849.473589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1849.473631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1849.473827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1849.473969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1849.474135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-341691f6-6d0f-417c-805a-c5465b2c6f84" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.178404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: SUCCESS [ 1851.178688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.178781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1851.179043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1851.179242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1851.179359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1851.179398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1851.179563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1851.179649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.179738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.179857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1851.189190] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1851.195364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00733a16-9d48-41eb-b0e1-9aaad9cc6253: rpc.has_security_group_logging(os_id): False [ 1851.212816] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1851.212953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1851.213026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1851.213239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1851.213341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.213582] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1851.213683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1851.213745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1851.213897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1851.213975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.214094] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be created. [ 1851.270921] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1851.271120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1851.271120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1851.271331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1851.271526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1851.282080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: IN_PROGRESS for 2s [ 1853.294592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: SUCCESS [ 1853.294917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1854.065478] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1854.065635] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1859.066930] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1859.067269] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1864.068366] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1864.068653] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1869.070003] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1869.070003] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1874.071170] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1874.071534] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1879.072255] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1879.072592] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1884.073905] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1884.074199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1889.075737] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1889.075979] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1894.077333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1894.077796] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1896.706875] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-811958e5-978f-4d29-b780-3245490a954c req-227a51d3-3bb5-4e05-8be6-e5d03742dd39 tempest-ImagesTestJSON-226226016 tempest-ImagesTestJSON-226226016-project-member] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1896.707746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1896.708098] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.708243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.708315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.708516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.708601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1896.708762] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.708856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.708919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.709070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.709206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.709290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.709356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.709485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.709564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1896.709652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1896.718363] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.718732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.718732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.718732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.718939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1896.718939] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.719172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.719172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.719282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.719335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1896.719406] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1896.751582] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1896.751852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1896.751852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1896.752279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1896.752279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1896.762048] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1897.594906] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2c573800-bd69-4daf-af8f-a9ac78ce94ae req-05d96c88-a498-45fc-a2aa-1ebfe6ef8939 tempest-ImagesTestJSON-226226016 tempest-ImagesTestJSON-226226016-project-member] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1897.595485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1897.596169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.596299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.596555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.596648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.596648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1897.596867] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.596958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.992182] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.992552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.992552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.992768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.993212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1897.993212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-219 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.993360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.993467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.993679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.993925] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.994084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.994207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.994423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.994572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1897.994720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-219" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1897.994971] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.995126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.995248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.995450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.995588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1897.995824] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-208bbce8-6035-4f3a-8c36-828fb2e53fbf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1897.995979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1897.996142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1897.996403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1897.996543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208bbce8-6035-4f3a-8c36-828fb2e53fbf',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.011149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.011335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.011466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.011696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.011844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.011995] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 208bbce8-6035-4f3a-8c36-828fb2e53fbf not found, creating... [ 1898.012284] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.012477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.012606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.012818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.012962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.013249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.013411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.013601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.013824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.013966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.014110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 208bbce8-6035-4f3a-8c36-828fb2e53fbf is going to be created. [ 1898.034528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.034787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.034925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.035182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.035418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.035643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.299893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2c573800-bd69-4daf-af8f-a9ac78ce94ae req-65685aae-ea73-4cd4-90ea-d643b91ee63c service neutron] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_rules [ 1898.300105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2c573800-bd69-4daf-af8f-a9ac78ce94ae req-65685aae-ea73-4cd4-90ea-d643b91ee63c service neutron] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1898.300255] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2c573800-bd69-4daf-af8f-a9ac78ce94ae req-65685aae-ea73-4cd4-90ea-d643b91ee63c service neutron] Enqueued Resource ID: 208bbce8-6035-4f3a-8c36-828fb2e53fbf with Priority: HIGHEST for action port [ 1898.300769] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_rules [ 1898.300905] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 1898.301006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 208bbce8-6035-4f3a-8c36-828fb2e53fbf with Priority: HIGHEST for action port [ 1898.301282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.301409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.301477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.301681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.301787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.301944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.302041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.302105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.302252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.302329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.303126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.303239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.303346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.303455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.303756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.303756] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.303756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.303981] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.304090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.304153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.304294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.304370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.304509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-208bbce8-6035-4f3a-8c36-828fb2e53fbf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.304599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.304660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.304823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.304896] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208bbce8-6035-4f3a-8c36-828fb2e53fbf',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.325032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.325179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.325251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.325446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.325527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.325688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.325767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.325922] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 208bbce8-6035-4f3a-8c36-828fb2e53fbf with status ACTIVE [ 1898.326159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.326267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.326335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.326485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.326566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.326727] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.326820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.326883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.327024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.327127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.665233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.665375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.665527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.665665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.665753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.665854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 208bbce8-6035-4f3a-8c36-828fb2e53fbf is going to be updated. [ 1898.687311] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.687531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.687531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.687771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.687938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.688158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-208bbce8-6035-4f3a-8c36-828fb2e53fbf" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.771775] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1898.772030] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f deletion is rescheduled due to dependency. [ 1898.772181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.772334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.772587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.772802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.773011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.773086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.773347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.773417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.773496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.782161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.791780] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1898.799351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.799555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.799636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.799847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.799943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.800073] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1898.844228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1898.844470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1898.844470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1898.845150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1898.845150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1898.855736] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1900.867464] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1900.868338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1900.868338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1900.868338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1900.868338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.868492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1900.868492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1900.868601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1900.868690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1900.868788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1900.876463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1900.885078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1900.891161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.891292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1900.891362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1900.891564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1900.891657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1900.891761] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1900.919341] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1900.919494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1900.919534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1900.919744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1900.919892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1900.928308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1902.939894] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1902.940219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.940308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.940506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.940703] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.940820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.940889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.941042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.941128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.941215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.941308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1902.950250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.950410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.950475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.950616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.950699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.950860] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.950953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.951011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.951158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.951304] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.951398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.951458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.951594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.951673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.951755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.951908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.951999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.952129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.952219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.952276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.952412] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.952505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.952563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.952700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.952837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.952928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.952987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.953120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.953197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.953279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.953363] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1902.961240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 1902.978634] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.978785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.978862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.979037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.979130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.979359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.979460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.979518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.979667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.979745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.979923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.980031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.980120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.980268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.980388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.980528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1902.980618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1902.980672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1902.980807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1902.980882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1902.980967] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1903.042108] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1903.042322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1903.042322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1903.042514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1903.042663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1903.057071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1903.302319] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1903.302477] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1905.076905] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1905.077327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1908.303812] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1908.304191] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1913.304559] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1913.304916] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1918.306275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1918.306617] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1923.307755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1923.308171] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1928.309147] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1928.309527] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1933.310624] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1933.310991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1938.311998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1938.311998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1943.312827] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1943.313139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1946.761850] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b31b9af3-67b4-4d42-82c2-188cb56771db req-809fd41b-67f3-4224-9ff9-30029504f364 tempest-ServersNegativeTestJSON-1891512129 tempest-ServersNegativeTestJSON-1891512129-project-member] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1946.762430] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGHEST for action security_group_members [ 1946.762749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.762889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.762958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.763181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.763267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1946.763436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.763534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.763597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.763780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.763927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.764035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.764101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.764271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.764361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1946.764460] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1946.774510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.774641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.774719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.774950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.775000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1946.775186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.775307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.775339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.775480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.775560] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1946.775639] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be updated. [ 1946.806121] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.806261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1946.806344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1946.806695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1946.806695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1946.824782] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: IN_PROGRESS for 2s [ 1947.662314] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-70559087-2c80-4792-83f4-899e5bf27ed8 req-8d8478f7-b9a5-46e0-93f0-3c2cd9be5b5b tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1947.662839] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1947.663157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.663283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1947.663343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1947.663549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1947.663653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1947.663818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.663920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1947.663983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1947.664150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1947.664291] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.664388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1947.664441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1947.664568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1947.664642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1947.664728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.673795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.687113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.696474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.696622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1947.696683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1947.696884] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1947.696975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1947.697071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1947.726724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.727250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1947.727332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1947.727542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1947.727696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1947.737019] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1948.071745] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.072099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.072099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.072354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.072509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.072840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-842 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.072932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.073040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.074941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.075326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.075326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.075595] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-79014c0d-af0e-4b99-b103-a613baf4fefa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.075595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.075703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.075942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.076098] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79014c0d-af0e-4b99-b103-a613baf4fefa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.091764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.091965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.092114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.092375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.092526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.092680] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 79014c0d-af0e-4b99-b103-a613baf4fefa not found, creating... [ 1948.092927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.093087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.093211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.093429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.093571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.093850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.094010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.094132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.094341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.094481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.094623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 79014c0d-af0e-4b99-b103-a613baf4fefa is going to be created. [ 1948.121149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.121369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.121496] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.121772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.122012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.122247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.599673] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-70559087-2c80-4792-83f4-899e5bf27ed8 req-70eee8ec-e04a-4070-82bb-4e43e27a02f2 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1948.599866] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-70559087-2c80-4792-83f4-899e5bf27ed8 req-70eee8ec-e04a-4070-82bb-4e43e27a02f2 service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1948.600034] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-70559087-2c80-4792-83f4-899e5bf27ed8 req-70eee8ec-e04a-4070-82bb-4e43e27a02f2 service neutron] Enqueued Resource ID: 79014c0d-af0e-4b99-b103-a613baf4fefa with Priority: HIGHEST for action port [ 1948.600259] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 1948.600391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 1948.600483] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79014c0d-af0e-4b99-b103-a613baf4fefa with Priority: HIGHEST for action port [ 1948.601015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.601142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.601215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.601482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.601619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.601847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.602009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.602115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.602322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.602430] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.603279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.603391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.603455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.603612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.603692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.603844] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.603965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.604282] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.604446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.604565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.604795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.604927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.605139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-79014c0d-af0e-4b99-b103-a613baf4fefa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.605291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.605373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.605573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.605678] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79014c0d-af0e-4b99-b103-a613baf4fefa',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1948.621746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.621920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.622058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.622407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.622562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.622842] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.622998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.625485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79014c0d-af0e-4b99-b103-a613baf4fefa with status ACTIVE [ 1948.625752] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.625925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.626054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.626425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.626495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.626774] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1948.626948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1948.627236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1948.627322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1948.627467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1948.840023] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9014b003-e476-4ebb-b600-3ffb812c8241 in Status: SUCCESS [ 1948.840469] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 deletion is rescheduled due to dependency. [ 1948.840657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.082744] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.083095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1949.083095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.083159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.083251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.083347] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79014c0d-af0e-4b99-b103-a613baf4fefa is going to be updated. [ 1949.105160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.105331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1949.105433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.105708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.105918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.106143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79014c0d-af0e-4b99-b103-a613baf4fefa" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.746587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1949.746820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.746981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.747199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.747389] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.747509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1949.747576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.747731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.747815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.747911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1949.756359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1949.766815] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1949.774898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.775046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1949.775111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.775312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.775403] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.775493] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1949.805634] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1949.805831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1949.805874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1949.806101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1949.806266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1949.815456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1949.827904] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:5 completed [ 1949.828057] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:6 started [ 1951.826232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1951.826581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.826692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.826843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.827037] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.827154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.827222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.827367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.827451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.827538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.827626] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.836519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.836655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.836718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.836866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.836947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.837099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.837200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.837256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.837394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.837535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.837626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.837684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.837817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.837894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.837973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.838172] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.838270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.838333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.838466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.838539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.838677] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.838765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.838826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.838997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.839158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.839245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.839306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.839439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.839514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.839594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.839676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1951.845245] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1951.863641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.863813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.863855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.864064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.864159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.864375] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.864475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.864539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.864682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.864761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.864949] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.865043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.865105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.865243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.865319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.865498] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1951.865585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1951.865650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1951.865774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1951.865848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1951.865932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1952.017967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1952.018193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1952.018193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1952.018471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1952.018686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1952.052701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1953.602113] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1953.602384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1954.067248] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1954.067478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1958.603581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1958.603817] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1963.604990] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1963.605310] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1968.606854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1968.607109] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1973.608489] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1973.608790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1978.609591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1978.609591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1981.709920] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1981.710266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1981.710266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1981.710482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1981.710572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1981.710771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1981.710879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1981.710942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1981.711076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1981.711174] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1981.719596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1981.726114] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1981.733368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1981.733459] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1982.433176] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.433401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.433401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.433728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.444728] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1982.445229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.446452] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1982.484637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.484796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.484925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.485216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.500402] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.501431] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:11. [ 1982.501563] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'8b3e31ee-b0a4-4160-b452-cd8103ac6577', 'f5b3d796-b63d-4439-a507-bc68bdaaeb11', '4076d222-f310-4efa-b9a9-e19498130a4b', '211b322d-edb3-4178-8309-a79d5b4fedb5', 'ca77228b-f5f4-4c39-8e74-90a5ba3d91f2', 'b15cea3c-7b8d-4e8c-90e6-d52782e895eb', '7ac12566-ec65-4e8e-8ab4-2cef5828fd4b', '9d537324-0d45-48b8-ae8f-de50feadabd0', 'ddaeb1ad-67d3-40a5-8f1b-19e528873866', 'cb7c3380-d0e9-4740-81b7-819167ad11e2', '8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1982.501696] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1982.527387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.527584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.527693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.527824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.528550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.528681] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1982.573684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.573888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.573888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.574113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.574354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.574530] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1982.623288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.623461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.623513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.623713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.623910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.624127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:11. [ 1982.624213] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'518a0bec-8c5a-406d-bdb3-ca7657d7078f', 'fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'a7ab204b-f602-43f2-b825-e60a546adb0f', '9014b003-e476-4ebb-b600-3ffb812c8241', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', '1de9de8a-4c0a-41a7-988f-e927d9085506', '18832a39-e87e-45f8-beda-f4a5d65556d4', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', '00733a16-9d48-41eb-b0e1-9aaad9cc6253', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1982.624282] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1982.642316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.642511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.642592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.642810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.642895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.643005] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1982.643080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1982.643151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1982.686092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1982.686295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1982.686295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1982.686458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1982.686942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.687126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1982.687200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1982.687267] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1982.687332] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 11/11 resources of Type:Ports [ 1982.687411] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b3e31ee-b0a4-4160-b452-cd8103ac6577 with Priority: HIGH for action port [ 1982.687486] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5b3d796-b63d-4439-a507-bc68bdaaeb11 with Priority: HIGH for action port [ 1982.687550] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4076d222-f310-4efa-b9a9-e19498130a4b with Priority: HIGH for action port [ 1982.687610] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 211b322d-edb3-4178-8309-a79d5b4fedb5 with Priority: HIGH for action port [ 1982.687669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca77228b-f5f4-4c39-8e74-90a5ba3d91f2 with Priority: HIGH for action port [ 1982.687727] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b15cea3c-7b8d-4e8c-90e6-d52782e895eb with Priority: HIGH for action port [ 1982.687785] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ac12566-ec65-4e8e-8ab4-2cef5828fd4b with Priority: HIGH for action port [ 1982.687842] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d537324-0d45-48b8-ae8f-de50feadabd0 with Priority: HIGH for action port [ 1982.687899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ddaeb1ad-67d3-40a5-8f1b-19e528873866 with Priority: HIGH for action port [ 1982.688019] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb7c3380-d0e9-4740-81b7-819167ad11e2 with Priority: HIGH for action port [ 1982.688113] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f with Priority: HIGH for action port [ 1982.688196] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 9/11 resources of Type:Security Group Rules [ 1982.688344] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1982.688344] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 1982.688413] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1982.688450] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1982.688481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1982.688533] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1982.688591] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 1982.688647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1982.688705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1982.688799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.610926] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1983.611208] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1983.611208] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3e31ee-b0a4-4160-b452-cd8103ac6577 with Priority: HIGH for action port [ 1983.611286] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4076d222-f310-4efa-b9a9-e19498130a4b with Priority: HIGH for action port [ 1983.611401] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac12566-ec65-4e8e-8ab4-2cef5828fd4b with Priority: HIGH for action port [ 1983.611464] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9014b003-e476-4ebb-b600-3ffb812c8241 with Priority: HIGH for action security_group_rules [ 1983.611557] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 1983.611649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_rules [ 1983.611738] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 1983.611849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 1983.611963] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 1983.612062] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 1983.612140] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 1983.612230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 1983.612308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f with Priority: HIGH for action port [ 1983.612398] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb7c3380-d0e9-4740-81b7-819167ad11e2 with Priority: HIGH for action port [ 1983.612476] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaeb1ad-67d3-40a5-8f1b-19e528873866 with Priority: HIGH for action port [ 1983.612562] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15cea3c-7b8d-4e8c-90e6-d52782e895eb with Priority: HIGH for action port [ 1983.612645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d537324-0d45-48b8-ae8f-de50feadabd0 with Priority: HIGH for action port [ 1983.612718] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca77228b-f5f4-4c39-8e74-90a5ba3d91f2 with Priority: HIGH for action port [ 1983.612804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5b3d796-b63d-4439-a507-bc68bdaaeb11 with Priority: HIGH for action port [ 1983.612892] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 211b322d-edb3-4178-8309-a79d5b4fedb5 with Priority: HIGH for action port [ 1983.613250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.613387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.613454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.613670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.613753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.613918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3e31ee-b0a4-4160-b452-cd8103ac6577 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.614012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3e31ee-b0a4-4160-b452-cd8103ac6577" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.614076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3e31ee-b0a4-4160-b452-cd8103ac6577" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.614264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3e31ee-b0a4-4160-b452-cd8103ac6577" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.614348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3e31ee-b0a4-4160-b452-cd8103ac6577',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.615335] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.615448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.615517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.615666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.615743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.615884] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-4076d222-f310-4efa-b9a9-e19498130a4b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.616023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4076d222-f310-4efa-b9a9-e19498130a4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.616129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4076d222-f310-4efa-b9a9-e19498130a4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.616239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4076d222-f310-4efa-b9a9-e19498130a4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.616310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4076d222-f310-4efa-b9a9-e19498130a4b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.617117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.617235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.617506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.617506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.617611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.617724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac12566-ec65-4e8e-8ab4-2cef5828fd4b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.617814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac12566-ec65-4e8e-8ab4-2cef5828fd4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.617885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac12566-ec65-4e8e-8ab4-2cef5828fd4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.618058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac12566-ec65-4e8e-8ab4-2cef5828fd4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.618158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac12566-ec65-4e8e-8ab4-2cef5828fd4b',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.620142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.620245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.620334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.620460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.620535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.620676] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9014b003-e476-4ebb-b600-3ffb812c8241 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.620775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.620835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.620972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.621039] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9014b003-e476-4ebb-b600-3ffb812c8241',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.621778] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.621878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.622022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.622179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.622260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.622463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.622547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.622611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.622747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.622815] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.623652] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.623652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.623722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.623813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.623889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.624064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.624161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.624224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.624363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.624435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.625104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.625208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.625277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.625424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.625500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.625654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.625745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.625823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.625943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.626007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.626879] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.626990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.627056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.627204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.627319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.627420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.627512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.627573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.627709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.627778] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.628526] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.628629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.628696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.628844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.628922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.629066] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.629208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.629284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.629428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.629498] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.630215] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.630290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.630358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.630505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.630582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.630721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.630811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.630871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.631009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.631078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.631770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.632084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.632084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.632084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.632208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.632320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.632411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.632474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.632610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.632678] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.633461] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.633618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.633678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.633772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.633847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.633992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.634077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.634138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.634274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.634343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.635038] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.635144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.635226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.635374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.635450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.635592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.635672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.635736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.636117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.636211] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.636863] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.636970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.637036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.637181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.637260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.637400] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb7c3380-d0e9-4740-81b7-819167ad11e2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.637490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb7c3380-d0e9-4740-81b7-819167ad11e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.637550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb7c3380-d0e9-4740-81b7-819167ad11e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.637719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb7c3380-d0e9-4740-81b7-819167ad11e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.637789] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb7c3380-d0e9-4740-81b7-819167ad11e2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.638611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.638717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.638784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.638931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.639006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.639151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddaeb1ad-67d3-40a5-8f1b-19e528873866 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.639237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddaeb1ad-67d3-40a5-8f1b-19e528873866" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.639302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddaeb1ad-67d3-40a5-8f1b-19e528873866" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.639471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddaeb1ad-67d3-40a5-8f1b-19e528873866" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.639541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddaeb1ad-67d3-40a5-8f1b-19e528873866',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.640355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.640355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.640476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.640562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.640637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.640773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15cea3c-7b8d-4e8c-90e6-d52782e895eb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.640858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15cea3c-7b8d-4e8c-90e6-d52782e895eb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.640917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15cea3c-7b8d-4e8c-90e6-d52782e895eb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.641079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15cea3c-7b8d-4e8c-90e6-d52782e895eb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.641150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15cea3c-7b8d-4e8c-90e6-d52782e895eb',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.642006] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.642006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.642006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.642185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.642221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.642347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d537324-0d45-48b8-ae8f-de50feadabd0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.642428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d537324-0d45-48b8-ae8f-de50feadabd0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.642492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d537324-0d45-48b8-ae8f-de50feadabd0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.642925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d537324-0d45-48b8-ae8f-de50feadabd0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.643000] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d537324-0d45-48b8-ae8f-de50feadabd0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.643791] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.643791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.643916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.644014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.644102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.644246] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca77228b-f5f4-4c39-8e74-90a5ba3d91f2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.644350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca77228b-f5f4-4c39-8e74-90a5ba3d91f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.644393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca77228b-f5f4-4c39-8e74-90a5ba3d91f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.644556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca77228b-f5f4-4c39-8e74-90a5ba3d91f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.644617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca77228b-f5f4-4c39-8e74-90a5ba3d91f2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.645557] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.645673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.645739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.645890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.645972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.646130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5b3d796-b63d-4439-a507-bc68bdaaeb11 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.646255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5b3d796-b63d-4439-a507-bc68bdaaeb11" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.646291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5b3d796-b63d-4439-a507-bc68bdaaeb11" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.646444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5b3d796-b63d-4439-a507-bc68bdaaeb11" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.646513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5b3d796-b63d-4439-a507-bc68bdaaeb11',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.647396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.647489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.647559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.647707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.647783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.647999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-211b322d-edb3-4178-8309-a79d5b4fedb5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.647999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-211b322d-edb3-4178-8309-a79d5b4fedb5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.648170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-211b322d-edb3-4178-8309-a79d5b4fedb5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.648266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-211b322d-edb3-4178-8309-a79d5b4fedb5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.648338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('211b322d-edb3-4178-8309-a79d5b4fedb5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.659056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b3e31ee-b0a4-4160-b452-cd8103ac6577 [ 1983.659291] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.659446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.659615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.659753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.659808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.673518] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ac12566-ec65-4e8e-8ab4-2cef5828fd4b [ 1983.673732] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.673918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.673918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.674122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.674212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.675893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b15cea3c-7b8d-4e8c-90e6-d52782e895eb [ 1983.676151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.676253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.676324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.676501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.676583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.685186] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4076d222-f310-4efa-b9a9-e19498130a4b [ 1983.685474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.685548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.685592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.685792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.685883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.724927] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb7c3380-d0e9-4740-81b7-819167ad11e2 [ 1983.725147] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.725277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.725368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.725581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.725671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.726662] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddaeb1ad-67d3-40a5-8f1b-19e528873866 [ 1983.726837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.726942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.727007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.727174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.727250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.731059] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f [ 1983.731266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.731406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.731479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.731673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.731758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.733388] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca77228b-f5f4-4c39-8e74-90a5ba3d91f2 [ 1983.733558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.733666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.733733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.733888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.733969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.734768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5b3d796-b63d-4439-a507-bc68bdaaeb11 [ 1983.734926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.735028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.735093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.735243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.735317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.736125] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 211b322d-edb3-4178-8309-a79d5b4fedb5 [ 1983.736281] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.736384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.736449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.736594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.736673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.743078] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d537324-0d45-48b8-ae8f-de50feadabd0 [ 1983.743254] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.743389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.743493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.743634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.743720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.745071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.745177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.745248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.745450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.745539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.745690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.745781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.745838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.745980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.746122] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.746212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.746274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.746408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.746487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.746567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.746651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.752225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.752344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.752446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.752593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.752677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.752829] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.752924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.752989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.753149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.753287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.753392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.753466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.753616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.753696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.753779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.753865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.756076] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.756204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.756204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.756339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.756444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.756596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.756689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.756753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.756904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.757043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.757135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.757197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.757333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.757410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.757492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.757572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.758387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.758495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.758561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.758708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.758786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.758930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.759023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.759083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.759240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.759393] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.759487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.759548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.759733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.759836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.759926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.760018] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.769563] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.769725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.769779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.769983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.770068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.770238] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.770334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.770398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.770544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.770687] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.770780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.770841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.770980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.771059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.771141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.771227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.772223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.772296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.772331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.772465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.772543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.772686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.772777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.772839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.772979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.773114] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.773204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.773265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.773400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.773506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.773629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.773723] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.774519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.774627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.774695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.774842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.774919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.775063] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.775156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.775247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.775360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.775499] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.775590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.775651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.775782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.775856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.775936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.776027] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.786279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.786419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.786491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.786695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.786778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.786940] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.787040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.787103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.787282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.787396] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.787491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.787551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.787688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.787767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.787849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.787999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.788129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.788188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.788331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.788404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.788544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.788632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.788693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.789224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.789224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.789224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.789224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.789422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.789422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.789422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.789510] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.790413] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.790522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.790591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.790738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.790816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.790962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.791054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.791119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.791259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.791440] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.791556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.791621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.791763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.791881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.791914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.792086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.792182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.792244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.792380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.792531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.792577] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.792667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.792726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.792860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.792994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.793085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.793160] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.793334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.793405] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.793488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.793574] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.799587] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.800406] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.802818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.802969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.803008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.803215] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.806005] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.806126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.806194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.806386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.806466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.806625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.806719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.806781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.806921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.807062] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.807154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.807217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.807352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.807430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.807511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.807660] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.807749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.807810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.807940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.808356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.808356] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.808356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.808356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.808542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.808575] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.808655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.808715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.808848] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.808922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.809001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.809086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.809927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.810035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.810105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.810254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.810332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.810475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.810567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.810628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.810766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.810904] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.810994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.811111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.811190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.811266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.811352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.811497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.811586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.811647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.811782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.811854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.811994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.812120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.812154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.812282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.812422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.812512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.812572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.812804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.812804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.812880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.812912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.821111] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.821254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.821324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.821523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.821605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.821767] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.821867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.821931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.822080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.822224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.822752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.823082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.823082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.823082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.823082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.823227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.823258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.823338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.823399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.823532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.823668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.823757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.823815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.823948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.824040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.824125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.824210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1983.825038] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 1983.829237] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.829358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.830701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf69e81-3cbd-4cd2-b99e-b75388d904b7: rpc.has_security_group_logging(os_id): False [ 1983.831667] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1de9de8a-4c0a-41a7-988f-e927d9085506: rpc.has_security_group_logging(os_id): False [ 1983.832947] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 1983.834127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 1983.840238] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.840458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.840508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.840685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.840779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.840913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac12566-ec65-4e8e-8ab4-2cef5828fd4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.841972] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 1983.842971] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ab204b-f602-43f2-b825-e60a546adb0f: rpc.has_security_group_logging(os_id): False [ 1983.845359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.845477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.845548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.845738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.845826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.846052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3e31ee-b0a4-4160-b452-cd8103ac6577" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.848591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.848733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.848778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.848970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.849059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.849188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15cea3c-7b8d-4e8c-90e6-d52782e895eb" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.853169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.853394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.853394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.853539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.853625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.853751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4076d222-f310-4efa-b9a9-e19498130a4b" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.884301] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.884481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.885255] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.885355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.886120] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.886218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.886911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.887025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9014b003-e476-4ebb-b600-3ffb812c8241 is going to be deleted. [ 1983.887944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.888283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.889776] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.889895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.890525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.890621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.902839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.903021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.906355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.906515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.906582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.906834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.906967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.907126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-211b322d-edb3-4178-8309-a79d5b4fedb5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.907856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.907967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.908052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.908299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.908387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.908520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d537324-0d45-48b8-ae8f-de50feadabd0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.909141] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1983.909643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.909755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.909823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.909987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.910069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.910198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5b3d796-b63d-4439-a507-bc68bdaaeb11" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.910758] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1983.911147] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.911262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.911334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.911584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.911671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.911804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca77228b-f5f4-4c39-8e74-90a5ba3d91f2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.912342] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1983.912722] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.912833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.912916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.913140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.913230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.913358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb7c3380-d0e9-4740-81b7-819167ad11e2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.914115] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1983.914505] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.914598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.916947] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1983.917351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.917463] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be deleted. [ 1983.918453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.918633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.953496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.954106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.954106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.954106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.954106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.954260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8276f18f-1e1b-4bb7-83cb-a6b8cb051d0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.984644] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1983.984833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1983.984875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1983.985073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1983.985214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1983.985296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddaeb1ad-67d3-40a5-8f1b-19e528873866" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.022051] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1984.022558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.022890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.023040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.023122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.023334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.023422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.023628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.023729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.023792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.023940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.024034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.024228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.024523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.024523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.024523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.024614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.024661] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 1984.025839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.026002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.082424] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.082846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.146998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.147542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.147542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.147542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.147879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.147879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.148015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.148131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.148193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.148352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.148431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.148621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.148707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.148777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.148895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.148973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.149069] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 1984.150283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.150465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.190938] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.190938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.204383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.204738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.204869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.204942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.205154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.205243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.205450] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.205550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.205613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.205763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.205841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.206024] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.206240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.206346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.206525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.206641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.206755] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 1984.208171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.208369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.219260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.220170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.271777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.271777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.272089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.272089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.272191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.272249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.272452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.272550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.272614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.272762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.272862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.273025] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.273106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.273169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.273309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.273386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.273480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 1984.274694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.274855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.372468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.372781] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.372923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.372981] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.373187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.373259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.373451] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.373548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.373607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.373745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.373820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.374002] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.374084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.374142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.374270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.374345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.374437] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 1984.375554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.375717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.384493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.384663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.409075] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.409327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.429693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.430151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.430248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.430342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.430599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.430722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.430854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be updated. [ 1984.432410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.432659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.434561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.434708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.461842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.462336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.462499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.462596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.462827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.462942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.463067] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be updated. [ 1984.464330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.464551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.464675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.464829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9014b003-e476-4ebb-b600-3ffb812c8241" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.464995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.465182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.465290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.465439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.465641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.465816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.466135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.467245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.467463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.467642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.469124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.469587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.469790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.470736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.470942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.471114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.499579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.499836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.499902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.500167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.500366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.508217] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 1984.515849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 1984.522001] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 1984.527106] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 1984.568112] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 1984.583072] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1984.583772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.584171] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.584287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.584541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.584731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.628651] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: IN_PROGRESS for 2s [ 1984.656620] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1984.657294] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.657476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.657581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.657827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.658110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.682974] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: IN_PROGRESS for 2s [ 1986.523534] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 1986.523907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.526864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 1986.527055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.537037] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 1986.537234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.539356] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 1986.539537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.581075] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 1986.581305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.646789] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: SUCCESS [ 1986.646996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.696387] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: SUCCESS [ 1986.696552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1988.614381] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1988.614719] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1989.460386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-0de43209-4ae3-4e08-a1c2-1a980a6f1c49 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 1989.460911] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 1989.461253] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.461370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.461433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.461651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.461730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.461878] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.461972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.462024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.462238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.462310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1989.497682] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.497865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.497910] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.498121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.498235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.498380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 already deleted. [ 1989.498445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.543122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-a6fbe33d-0fbf-457f-a76d-a50368a895bc tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 1989.543765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 1989.544096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.544222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.544293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.544490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.544575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.544729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.544824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.544986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.545180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.545263] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1990.146801] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 already deleted. [ 1990.146801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1994.545161] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1994.545504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1997.355654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-749f5d95-ad12-4300-826e-48971f0d6f74 req-220eb6d8-7ea5-461d-a12b-4280e35ddb41 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1997.355654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGHEST for action security_group_members [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1997.355654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1997.364979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.365353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.365537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.365871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.366199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1997.366496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.366724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.366878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.368491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.368491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1997.368491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be updated. [ 1997.401528] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1997.401528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1997.401528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1997.401528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1997.401528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1997.409022] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: IN_PROGRESS for 2s [ 1998.398005] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2e21fb24-0ac9-492b-b56c-7fc748f0c1da req-1d80fb70-6803-49ab-8583-63434ecad7a9 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1998.398745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1998.399298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.399431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.399502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.399698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.399786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.399948] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.400065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.400127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.400279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.400427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.400514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.400574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.400712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.400790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.400877] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.411365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.421566] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.429157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.429318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.429485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.429597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.429686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.429785] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 1998.461210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.461460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.461460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.461828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.461828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.470923] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 1998.733911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.733911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.733911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.733911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.734343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.734343] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-733 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.734343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.734458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.734758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.734932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.735094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.735217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.735426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.735570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.735721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.735981] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.736197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.736328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.736540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.736677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.738241] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-11d11885-444f-4ed9-afc6-47d9923e055d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.738241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.738241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.738241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.738611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d11885-444f-4ed9-afc6-47d9923e055d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1998.755361] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.755616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.755787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.756154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.756483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.756691] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 11d11885-444f-4ed9-afc6-47d9923e055d not found, creating... [ 1998.757534] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.757796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.757964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.758644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.758858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.759210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.759548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.759729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.760190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.760387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.760575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 11d11885-444f-4ed9-afc6-47d9923e055d is going to be created. [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1998.784136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.153351] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2e21fb24-0ac9-492b-b56c-7fc748f0c1da req-271f677f-113c-4670-8814-f3e1969c7802 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1999.153551] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2e21fb24-0ac9-492b-b56c-7fc748f0c1da req-271f677f-113c-4670-8814-f3e1969c7802 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1999.153705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2e21fb24-0ac9-492b-b56c-7fc748f0c1da req-271f677f-113c-4670-8814-f3e1969c7802 service neutron] Enqueued Resource ID: 11d11885-444f-4ed9-afc6-47d9923e055d with Priority: HIGHEST for action port [ 1999.153925] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 1999.154052] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 1999.154175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d11885-444f-4ed9-afc6-47d9923e055d with Priority: HIGHEST for action port [ 1999.154712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.154842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.154911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.155110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.155198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.155354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.155450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.155512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.155671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.155755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1999.157184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.157309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.157391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.157533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.157612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.157758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.157840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.158040] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.158158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.158232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.158408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.158489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.158631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-11d11885-444f-4ed9-afc6-47d9923e055d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.158724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.158787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.158928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.159000] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d11885-444f-4ed9-afc6-47d9923e055d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1999.183988] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.184156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.184229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.184436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.184521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.184692] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.184885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.188139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11d11885-444f-4ed9-afc6-47d9923e055d with status ACTIVE [ 1999.188400] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.188566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.188658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.188874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.189196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.189196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.189491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.189604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.189820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.189942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.419114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 in Status: SUCCESS [ 1999.419378] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 deletion is rescheduled due to dependency. [ 1999.419482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.497344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.497557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.497659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.497900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.498044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.498203] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11d11885-444f-4ed9-afc6-47d9923e055d is going to be updated. [ 1999.519611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.519831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.519955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.520234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.520428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.520665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11d11885-444f-4ed9-afc6-47d9923e055d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.880379] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-382ba2a1-3993-42ed-b8c3-0eb94e3334e4 req-9bdd55a5-b136-4758-8a50-06b9d5e9cc70 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 1999.880884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 1999.881203] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.881389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.881389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.881585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.881670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.881831] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.881930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.881993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.882183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.882329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.882425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.882488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.882626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.882707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.882794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1999.894567] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.894707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.894768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.894978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.895072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.895433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1999.895433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1999.895433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1999.895553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1999.895627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1999.899483] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 already deleted. [ 1999.899483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.486140] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2000.486476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.486623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.486822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.487012] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.487139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.487203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.487355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.487438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.487535] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.503021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.517746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.531738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.532068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.532068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.532357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.532487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.532609] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2000.584585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.584805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.584805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.584951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.585166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.598381] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2000.685665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.685917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.686098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.686407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.686573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.686865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-207 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.687029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.687153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.687395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.687661] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.687831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.687948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.688358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.688518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.688752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-207" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.689028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.689369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.689514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.689766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.689922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.690195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-c54654ba-552f-4027-ae06-6e691dfdd033 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.690366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.690521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.690804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.691158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54654ba-552f-4027-ae06-6e691dfdd033',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.711488] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.711754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.711902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.712228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.712394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.712558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port c54654ba-552f-4027-ae06-6e691dfdd033 not found, creating... [ 2000.712840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.713004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.713120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.713657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.713813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.714119] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.714282] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.714407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.714622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.714764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.714913] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: c54654ba-552f-4027-ae06-6e691dfdd033 is going to be created. [ 2000.736789] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.737072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.737149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.737527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.737697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.737936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.961217] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-382ba2a1-3993-42ed-b8c3-0eb94e3334e4 req-b8c4457f-189b-45bb-94fc-f84855bf7ade service neutron] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 2000.961409] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-382ba2a1-3993-42ed-b8c3-0eb94e3334e4 req-b8c4457f-189b-45bb-94fc-f84855bf7ade service neutron] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 2000.961557] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-382ba2a1-3993-42ed-b8c3-0eb94e3334e4 req-b8c4457f-189b-45bb-94fc-f84855bf7ade service neutron] Enqueued Resource ID: c54654ba-552f-4027-ae06-6e691dfdd033 with Priority: HIGHEST for action port [ 2000.961787] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_rules [ 2000.961941] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 2000.962063] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54654ba-552f-4027-ae06-6e691dfdd033 with Priority: HIGHEST for action port [ 2000.962648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.962777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.962868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.963042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.963126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.963290] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.963386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.963433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.963581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.963656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.965570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.967060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.967159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.967359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.967669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.967669] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.967753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.967796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.967944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.968170] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.968269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.968336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.968537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.968663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.968764] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.969708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.969813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.969877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.970029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.970106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.970248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54654ba-552f-4027-ae06-6e691dfdd033 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.970336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.970395] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.970557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.970629] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54654ba-552f-4027-ae06-6e691dfdd033',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2000.998622] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c54654ba-552f-4027-ae06-6e691dfdd033 with status ACTIVE [ 2000.998828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.998954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2000.999019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2000.999429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2000.999562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2000.999820] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2000.999960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.000068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.000288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.000377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.002665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2001.005013] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.005147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.005213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.005372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.005467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.005708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.005708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.019959] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2001.030751] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.030968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.030968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.031168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.031257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.031354] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be created. [ 2001.069905] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.070137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.070181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.070639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.070639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.081215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: UNINITIALIZED for 2s [ 2001.375035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.375201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.375244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.375452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.375598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.375706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c54654ba-552f-4027-ae06-6e691dfdd033 is going to be updated. [ 2001.397348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.397542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2001.397907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2001.398465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2001.398618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2001.398805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54654ba-552f-4027-ae06-6e691dfdd033" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.609932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2002.610232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.610347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.610592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.610788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.610902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.610969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.611114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.611197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.611283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.611372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2002.620622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.620788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.620830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.621012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.621116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.621307] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.621446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.621574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.621677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.621845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.621966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.622037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.622181] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.622283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.622493] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.622651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.622742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.622802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.622936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.623009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.623151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.623241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.623325] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.623473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.623613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.623703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.623763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.623896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.623971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.624066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.624182] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2002.632615] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2002.650910] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.651119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.651119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.651347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.671708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.672031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.672206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.672340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.672563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.672657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.673168] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.673304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.673338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.673494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.673576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.673778] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.673876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.673960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.674083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.674163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.674285] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2002.735285] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2002.735510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2002.735510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2002.735709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2002.735864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2002.751519] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2003.091279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: SUCCESS [ 2003.091504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.091761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2003.091999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2003.092216] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2003.092340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2003.092409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2003.092561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2003.092648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.092736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.092827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2003.102122] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2003.107797] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5dc1b16-b068-4af0-8edb-6a8c098bd113: rpc.has_security_group_logging(os_id): False [ 2003.126427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2003.126622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2003.126663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2003.126864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2003.126963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.127213] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2003.127318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2003.127383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2003.127536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2003.127615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.127706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be created. [ 2003.183174] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2003.183454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2003.183454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2003.183616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2003.183813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2003.192921] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: IN_PROGRESS for 2s [ 2004.764682] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2004.765005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2005.204701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: SUCCESS [ 2005.204919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2005.963407] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2005.963664] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2010.964771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2010.965213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2015.965471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2015.965791] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2020.966746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2020.967085] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2025.968222] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2025.968574] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2030.969380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2030.969380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2035.970480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2035.970770] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2040.971276] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2040.971633] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2045.972739] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2045.972739] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2048.767096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-e09ecc49-b0d9-4b9c-9218-55f4f26f82e6 req-e6454fec-dff1-48a2-b55c-19b877e0b881 tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2048.767640] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2048.767967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.768228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2048.768228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2048.768399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2048.768497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2048.768659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.768747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2048.768808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2048.768963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2048.769106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.769195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2048.769274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2048.769420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2048.769509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2048.769609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.778087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.791149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2048.798325] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.798485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2048.798532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2048.798726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2048.798812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2048.798907] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2048.829298] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2048.829458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2048.829539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2048.829737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2048.829897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2048.839861] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2049.599607] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7cd657a8-63d9-4346-ba6f-35d4b1e46950 req-47062336-1364-4e47-b4f8-5fb64c4ecff1 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2049.599607] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.599607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.611616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.623180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2049.634472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.634472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.634472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.634472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.634472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.634472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2049.667090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.667090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.667090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.667090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.667090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.674716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2049.983851] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.984138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.984266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.984478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.984628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.984883] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-445 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.985042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.985164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.985381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.985625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.985781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.985901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.986140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.986313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.986481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.986735] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.986891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.987015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.987223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.987362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2049.987601] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-c2798cef-b133-459d-a9be-c6783db5ab38 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2049.987759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2049.987880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2049.988326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2049.988468] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2798cef-b133-459d-a9be-c6783db5ab38',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2050.004031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.004031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.004248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.004345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.004511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.004668] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port c2798cef-b133-459d-a9be-c6783db5ab38 not found, creating... [ 2050.004919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.005078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.005199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.005415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.005557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.005837] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.006000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.006144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.006347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.006484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.006627] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: c2798cef-b133-459d-a9be-c6783db5ab38 is going to be created. [ 2050.030570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.030842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.030971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.031261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.031502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.031733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.269438] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7cd657a8-63d9-4346-ba6f-35d4b1e46950 req-2f658c77-d60f-468e-bd9a-1ea913563d5b service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2050.269657] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7cd657a8-63d9-4346-ba6f-35d4b1e46950 req-2f658c77-d60f-468e-bd9a-1ea913563d5b service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2050.269848] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7cd657a8-63d9-4346-ba6f-35d4b1e46950 req-2f658c77-d60f-468e-bd9a-1ea913563d5b service neutron] Enqueued Resource ID: c2798cef-b133-459d-a9be-c6783db5ab38 with Priority: HIGHEST for action port [ 2050.270383] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2050.270512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2050.270607] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2798cef-b133-459d-a9be-c6783db5ab38 with Priority: HIGHEST for action port [ 2050.270906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.271002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.271066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.271337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.271401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.271559] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.271654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.271713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.271878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.271950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2050.273144] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.273254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.273317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.273468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.273544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.273684] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.273758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.273945] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.274033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.274091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.274230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.274297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.274428] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2798cef-b133-459d-a9be-c6783db5ab38 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.274507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.274565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.274691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.274758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2798cef-b133-459d-a9be-c6783db5ab38',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2050.294913] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2798cef-b133-459d-a9be-c6783db5ab38 with status ACTIVE [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.294913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.295525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.295525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.295604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.295723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.295797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.295943] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.296046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.721251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.721515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.721515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.721694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.721802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.721922] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2798cef-b133-459d-a9be-c6783db5ab38 is going to be updated. [ 2050.747670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2050.747924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2050.747924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2050.748164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2050.748341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.748509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2798cef-b133-459d-a9be-c6783db5ab38" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2050.852175] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2050.852482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2051.684289] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2051.684916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2051.685196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2051.685605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2051.686019] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.686373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2051.686524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2051.686896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2051.687065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2051.687241] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.695862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.704400] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2051.710829] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.711114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2051.711283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2051.711581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2051.711771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2051.711955] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2051.738982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2051.739365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2051.739564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2051.739854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2051.740134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2051.749790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2053.760721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2053.761049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.761094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.761303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.761496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.761616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.761683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.761836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.761920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.762004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.762091] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2053.778159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.778290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.778333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.778515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.778599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.778777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.778875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.779187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.779187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.779292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.779340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.779384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.779527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.779610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.779693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.779844] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.779935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.780281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.780281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.780281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.780419] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.780419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.780509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.780636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.780771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.780862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.780924] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.781059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.781135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.781219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.781339] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2053.787633] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2053.805128] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.805297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.805344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.805541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.805664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.805865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.805964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.806027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.806212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.806289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.806475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.806569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.806632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.806771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.806847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.807035] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.807129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.807193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.807330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.807404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.807491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2053.865718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2053.865942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2053.865942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2053.866161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2053.866328] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2053.878585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2055.272077] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2055.272466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2055.893238] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2055.893503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2060.273756] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2060.274038] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2065.274558] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2065.274827] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2070.275207] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2070.275561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2075.276391] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2075.276864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2080.278050] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2080.278384] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2085.279173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2085.279586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2090.280828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2090.281251] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2095.282134] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2095.282416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2099.152735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-ed669cb2-6bf5-4d0a-89c4-70f084799e4e req-69ef3a28-74a6-4f2d-a0c2-7fbb06f13a5a tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2099.153277] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2099.153612] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2099.153846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2099.153846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2099.154039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2099.154092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2099.154225] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2099.154315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2099.155010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2099.155309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2099.163458] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2099.179746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2099.188604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2099.188766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2099.188810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2099.189028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2099.189176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2099.189343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2099.222621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2099.222789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2099.222835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2099.223047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2099.223199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2099.232201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2101.242857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2101.242857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2104.154116] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2104.154458] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2109.155790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2109.156230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2114.156855] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2114.156855] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2119.158312] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2119.158654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2124.159201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2124.159573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2129.160501] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2129.160834] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2134.161342] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2134.161691] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2139.163386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2139.163386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2144.163560] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2144.163895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2146.640665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7b623e03-edc8-41f3-8e5d-e96c9e2a1a33 req-da9a4ad7-0aaf-444a-a506-7056c2fc4cf5 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 2146.641199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGHEST for action security_group_members [ 2146.641586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.641722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.641792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.642017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.642105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2146.642266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.642360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.642421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.642569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.642706] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.642814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.642879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.643012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.643092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2146.643184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2146.658637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.658807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.658879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.659068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.659168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2146.659366] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.659463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.659527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.659666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.659748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2146.659837] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be updated. [ 2146.692927] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2146.693119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2146.693281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2146.693519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2146.693624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2146.726114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: IN_PROGRESS for 2s [ 2148.738297] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 in Status: SUCCESS [ 2148.738706] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 deletion is rescheduled due to dependency. [ 2148.738706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2151.642409] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2151.642665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2156.643386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2156.643791] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2161.644153] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2161.644471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2166.645635] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2166.646007] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2171.646561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2171.646561] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2176.647068] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2176.647404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2181.648425] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2181.648748] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2186.649346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2186.649671] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2189.828822] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:6 completed [ 2189.828822] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:7 started [ 2191.650786] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2191.650786] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2193.039099] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-a0ad1f9a-2301-4990-ae21-654f6d1df540 req-036e9baa-0846-4600-883f-223618c0e604 tempest-SecurityGroupsTestJSON-1742011264 tempest-SecurityGroupsTestJSON-1742011264-project-member] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 2193.039665] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGHEST for action security_group_members [ 2193.040310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.040450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.040514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.040706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.040789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2193.040946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.041042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.041105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.041249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.041392] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.041481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.041541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.041682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.041760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2193.041847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2193.051734] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.051734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.051734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.051734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.051984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2193.051984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.052078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.052110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.052259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.052338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2193.052424] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be updated. [ 2193.085836] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2193.085973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2193.086020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2193.086257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2193.086408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2193.096272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: IN_PROGRESS for 2s [ 2195.107758] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ab204b-f602-43f2-b825-e60a546adb0f in Status: SUCCESS [ 2195.108125] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f deletion is rescheduled due to dependency. [ 2195.108125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2198.041597] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2198.041981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2203.042791] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2203.043056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2204.180884] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-b165732f-a708-4676-a483-2a09c9c9397e None None] Enqueued Resource ID: 01c0cbed-503c-4202-afac-4b642115436c with Priority: HIGHEST for action port [ 2204.181152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01c0cbed-503c-4202-afac-4b642115436c with Priority: HIGHEST for action port [ 2204.181716] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2204.181842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2204.181914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2204.182105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2204.182193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2204.182349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-01c0cbed-503c-4202-afac-4b642115436c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2204.182435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01c0cbed-503c-4202-afac-4b642115436c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2204.182549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01c0cbed-503c-4202-afac-4b642115436c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2204.182680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01c0cbed-503c-4202-afac-4b642115436c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2204.182760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01c0cbed-503c-4202-afac-4b642115436c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2204.192274] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01c0cbed-503c-4202-afac-4b642115436c [ 2204.192476] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2204.192584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2204.192652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2204.192812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2204.192896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2204.192986] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01c0cbed-503c-4202-afac-4b642115436c already deleted. [ 2204.193066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01c0cbed-503c-4202-afac-4b642115436c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2205.792010] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-cbe0e156-7571-4f7d-826e-4cda02e5d735 req-3c3d431d-f4b2-440b-8b55-5540bc08b9f0 tempest-ImagesOneServerNegativeTestJSON-1483459504 tempest-ImagesOneServerNegativeTestJSON-1483459504-project-member] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2205.792611] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2205.792985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2205.793138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2205.793207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2205.793398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2205.793598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2205.793663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2205.793842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2205.793842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2205.794703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2205.794882] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2205.794988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2205.795058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2205.795227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2205.795319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2205.795427] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2205.858304] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2205.858449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2205.858525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2205.858805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2205.858805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2205.858977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2205.859079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2205.859140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2205.859361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2205.859399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2205.859485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 already deleted. [ 2205.859559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.076136] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.076401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.076535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.076813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.076963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.077243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-162 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.077407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.077527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.077809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.078044] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.078217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.078349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.078562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.078708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.078858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-162" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.079114] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.079315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.079448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.079656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.079792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.080048] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-49e510d7-6108-401c-a08e-2fc03655e226 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.080431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.080590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.080890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.081068] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49e510d7-6108-401c-a08e-2fc03655e226',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.117414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.117967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.118157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.118721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.118948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.119603] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 49e510d7-6108-401c-a08e-2fc03655e226 not found, creating... [ 2206.119950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.120286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.120475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.120752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.121145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.121606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.122178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.122380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.122639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.122817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.123005] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 49e510d7-6108-401c-a08e-2fc03655e226 is going to be created. [ 2206.149136] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.149450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.149612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.149917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.150214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.150473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.151907] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-93848f5d-0cba-4d97-8bfb-f43e209e052f None None] Enqueued Resource ID: 311e9780-a88b-4251-a26e-a884176d77ea with Priority: HIGHEST for action port [ 2206.152555] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311e9780-a88b-4251-a26e-a884176d77ea with Priority: HIGHEST for action port [ 2206.152893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.153027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.153113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.153340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.153451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.153622] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-311e9780-a88b-4251-a26e-a884176d77ea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.153738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-311e9780-a88b-4251-a26e-a884176d77ea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.153817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-311e9780-a88b-4251-a26e-a884176d77ea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.154035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-311e9780-a88b-4251-a26e-a884176d77ea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.154133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('311e9780-a88b-4251-a26e-a884176d77ea',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.171121] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 311e9780-a88b-4251-a26e-a884176d77ea [ 2206.171351] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.171494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.171582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.171828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.171955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.172139] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:311e9780-a88b-4251-a26e-a884176d77ea already deleted. [ 2206.172323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-311e9780-a88b-4251-a26e-a884176d77ea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.423843] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-cbe0e156-7571-4f7d-826e-4cda02e5d735 req-fac983c9-98e7-4f87-b66b-e2ccc43675ae service neutron] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_rules [ 2206.424054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-cbe0e156-7571-4f7d-826e-4cda02e5d735 req-fac983c9-98e7-4f87-b66b-e2ccc43675ae service neutron] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2206.424214] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-cbe0e156-7571-4f7d-826e-4cda02e5d735 req-fac983c9-98e7-4f87-b66b-e2ccc43675ae service neutron] Enqueued Resource ID: 49e510d7-6108-401c-a08e-2fc03655e226 with Priority: HIGHEST for action port [ 2206.424716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_rules [ 2206.424857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2206.424958] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e510d7-6108-401c-a08e-2fc03655e226 with Priority: HIGHEST for action port [ 2206.425247] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.425437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.425535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.425737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.425833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.425984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.426088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.426163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.426351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.426429] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.427249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.427361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.427430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.427582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.427662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.427804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.427898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.427959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.428119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.428318] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.428419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.428480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.428620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.428699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.428784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.429562] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.429669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.429735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.429883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.429959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.430102] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-49e510d7-6108-401c-a08e-2fc03655e226 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.430194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.430256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.430391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.430461] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49e510d7-6108-401c-a08e-2fc03655e226',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.442321] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.459509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.459689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.459769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.459983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.460099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.460279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.460360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.461388] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49e510d7-6108-401c-a08e-2fc03655e226 with status ACTIVE [ 2206.461568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.461678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.461748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.461917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.462003] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.462208] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.462310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.462373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.462524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.462608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.463697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.470664] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.470801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.470843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.471011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.471094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.471187] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be created. [ 2206.507659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.507879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.507879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.508127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.508314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.518587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: UNINITIALIZED for 2s [ 2206.802155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.802556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.802556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.802622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.802662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.802765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49e510d7-6108-401c-a08e-2fc03655e226 is going to be updated. [ 2206.829512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.829794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.829794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.830014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.830170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.830572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49e510d7-6108-401c-a08e-2fc03655e226" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.527808] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: SUCCESS [ 2208.528257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.528257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.528578] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.528790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.528919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.528989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.529157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.529246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.529339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.529437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2208.540862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.541011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.541090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.541287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.541376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.541544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.541642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.541699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.541847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.541991] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.542129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.542194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.542278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.542358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.542446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.542591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.542719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.542780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.542926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.543001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.543149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.543242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.543309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.543440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.543581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.543675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.543732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.543855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.543931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.544022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.544113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2208.550733] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18eb7d56-dc9c-4516-b37c-4f4d855b4682: rpc.has_security_group_logging(os_id): False [ 2208.568509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.568776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.568776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.568951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.569048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.569308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.569446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.569515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.569659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.569740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.569931] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.570030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.570088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.570228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.570304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.570537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.570654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.570721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.570858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.570933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.571020] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be created. [ 2208.679708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.680028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.680108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.680373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.680672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.693193] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: IN_PROGRESS for 2s [ 2210.707437] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: SUCCESS [ 2210.707827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2211.426321] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2211.426548] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2216.428099] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2216.428429] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2221.429582] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2221.429582] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2221.710520] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2221.710908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2221.710908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2221.710908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2221.711011] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2221.719435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2221.726631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2221.732893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2221.732985] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2222.404333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.404606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.404726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.405070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.423347] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2222.424128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.425258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2222.466456] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.466917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.466917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.467140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.481982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.483071] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:4. [ 2222.483190] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'856f8406-f39e-4bce-a94f-421561f6cabd', 'b763dde8-8a28-457b-bd0e-50c30206bee2', '8fb61bfc-b99b-4d58-81c0-efe9d197b506', 'ee9d1eac-b2e2-4c32-8a54-23a13889bd31'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2222.483365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2222.512593] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.512845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.512845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.513002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.513555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.513778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2222.556661] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.556921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.556921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.557083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.557326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.557583] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2222.614401] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.614656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.614656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.614847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.615094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.615240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:11. [ 2222.615325] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b5dc1b16-b068-4af0-8edb-6a8c098bd113', '518a0bec-8c5a-406d-bdb3-ca7657d7078f', 'fbf69e81-3cbd-4cd2-b99e-b75388d904b7', 'a7ab204b-f602-43f2-b825-e60a546adb0f', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', '1de9de8a-4c0a-41a7-988f-e927d9085506', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', '00733a16-9d48-41eb-b0e1-9aaad9cc6253', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488', '18eb7d56-dc9c-4516-b37c-4f4d855b4682'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2222.615432] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2222.633617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.633849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.633849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.634145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.634237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.634346] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2222.634420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2222.634482] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2222.685568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.685760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.685760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.686007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.686471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.686647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2222.686724] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2222.686835] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2222.686899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 4/4 resources of Type:Ports [ 2222.686976] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 856f8406-f39e-4bce-a94f-421561f6cabd with Priority: HIGH for action port [ 2222.687036] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b763dde8-8a28-457b-bd0e-50c30206bee2 with Priority: HIGH for action port [ 2222.687091] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fb61bfc-b99b-4d58-81c0-efe9d197b506 with Priority: HIGH for action port [ 2222.687147] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee9d1eac-b2e2-4c32-8a54-23a13889bd31 with Priority: HIGH for action port [ 2222.687206] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 11/11 resources of Type:Security Group Rules [ 2222.687258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2222.687311] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 2222.687365] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 2222.687426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 2222.687485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2222.687548] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2222.687600] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 2222.687655] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2222.687705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_rules [ 2222.687765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2222.687819] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2222.687873] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2222.687930] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2222.688104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.688245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.688312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.688445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.688522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.688696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.688787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.688840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.688975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.689047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.689212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.689389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.689389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.689503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.689555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.689696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.689783] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.689836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.689964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.690035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.690223] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.690361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.690430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.690571] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.690644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.690811] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.690901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.690953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.691087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.691158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.691320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.691410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.691463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.691594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.691666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.691827] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.691916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.691967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.692112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.692184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.692349] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.692435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.692488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.692620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.692692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.692850] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.692938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.692989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.693116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.693188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.693357] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.693514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.693514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.693624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.693676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.693835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.693922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.693975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.694104] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.694175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.694335] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.694422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.694475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.694601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.694670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.694918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.695027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.695079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.695217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.695291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.695454] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.695542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.695595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.695723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.695794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.695955] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.696118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.696118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.696257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.696331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.696496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.696584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.696638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.696765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.696836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.696995] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.697079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.697132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.697259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.697332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.697493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.697579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.697633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.697758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.697829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.697990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.698078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.698132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.698293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.698367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.698522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.698608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.698661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.698792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.698862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.699023] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.699111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.699178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.699305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.699470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.699552] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.699627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.699679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.699798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.699868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.700072] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.700170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.700223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.700357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.700429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.700592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.700681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.700735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.700861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.700932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.701092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.701180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.701232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.701361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.701431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.701592] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.701677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.701730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.701857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.701927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.702086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.702172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.702247] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.702425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.702501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.702666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.702755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.702809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.702938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.703009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.703169] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.703256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.703308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.703438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.703507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.703667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.703750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.703803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.703931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.704012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.704173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.704259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.704311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.704441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.704511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.704670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.704757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.704808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.704934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.705102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.705211] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:7 [ 2222.705295] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 5 of least updated resources [ 2222.705408] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_members [ 2222.705512] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_members [ 2222.705573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_members [ 2222.705642] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_members [ 2222.705706] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_members [ 2222.705799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.430150] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2226.430423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 2226.430423] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 856f8406-f39e-4bce-a94f-421561f6cabd with Priority: HIGH for action port [ 2226.430508] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb61bfc-b99b-4d58-81c0-efe9d197b506 with Priority: HIGH for action port [ 2226.430624] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_rules [ 2226.430729] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2226.430828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 with Priority: HIGH for action security_group_members [ 2226.430921] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105ab1e0-aa9d-412e-9840-c617dca8aede with Priority: HIGH for action security_group_members [ 2226.431010] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 with Priority: HIGH for action security_group_members [ 2226.431097] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 with Priority: HIGH for action security_group_members [ 2226.431187] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2226.431275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 with Priority: HIGH for action security_group_members [ 2226.431362] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_rules [ 2226.431587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2226.431587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 with Priority: HIGH for action security_group_rules [ 2226.431705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2226.431705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2226.431780] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 2226.431864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_rules [ 2226.431948] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2226.432044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b763dde8-8a28-457b-bd0e-50c30206bee2 with Priority: HIGH for action port [ 2226.432134] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9d1eac-b2e2-4c32-8a54-23a13889bd31 with Priority: HIGH for action port [ 2226.432486] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.432600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.432668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.432872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.432954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.433104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-856f8406-f39e-4bce-a94f-421561f6cabd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.433197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-856f8406-f39e-4bce-a94f-421561f6cabd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.433257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-856f8406-f39e-4bce-a94f-421561f6cabd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.433445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-856f8406-f39e-4bce-a94f-421561f6cabd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.433523] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('856f8406-f39e-4bce-a94f-421561f6cabd',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.434743] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.434851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.434964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.435065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.435140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.435281] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fb61bfc-b99b-4d58-81c0-efe9d197b506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.435372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fb61bfc-b99b-4d58-81c0-efe9d197b506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.435435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fb61bfc-b99b-4d58-81c0-efe9d197b506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.435704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fb61bfc-b99b-4d58-81c0-efe9d197b506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.435781] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fb61bfc-b99b-4d58-81c0-efe9d197b506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.436616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.436709] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.436747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.436980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.436980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.437082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.437172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.437232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.437366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.437434] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.438260] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.438374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.438443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.439077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.439077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.439077] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.439077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.439077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.439317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.439317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.439882] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.439989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.440086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.440236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.440312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.440452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-4801f783-8dbc-45ec-a773-4c5f10604f95 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.440568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.440665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.440824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.440963] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.441059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.441193] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.441251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.441320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.441398] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4801f783-8dbc-45ec-a773-4c5f10604f95',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.442180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.442286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.442354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.442500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.442575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.442818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-105ab1e0-aa9d-412e-9840-c617dca8aede taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.442818] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.442954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.442991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.443107] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.443197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.443257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.443465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.443465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.443567] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('105ab1e0-aa9d-412e-9840-c617dca8aede',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.444252] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.444361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.444426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.444595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.444670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.444808] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.444899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.444958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.445093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.445249] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.445308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.445369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.445500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.445572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.445650] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c61b63d-18fa-4fbd-b651-ed6a9bd62170',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.446449] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.446558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.446638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.446764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.446835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.446969] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.447055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.447113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.447243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.447369] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.447454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.447509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.447635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.447704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.447779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c221fa9-d7c5-4f9e-a059-1a11c92487e0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.448574] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.448672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.448735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.448912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.448984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.449120] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.449206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.449268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.449268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.449539] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.450504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.450624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.450690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.450835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.450942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.451042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.451128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.451626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.451626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.451769] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.451769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.451853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.451952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.452056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.452114] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa91f3d7-2dd6-42f5-ad5c-5e8869447833',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.452834] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.452936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.452999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.453170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.453244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.453381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.453464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.453522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.453666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.453730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.454405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.454504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.454566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.454720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.454789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.454922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.455002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.455058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.455187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.455250] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.456117] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.456213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.456278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.456418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.456486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.456618] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de9de8a-4c0a-41a7-988f-e927d9085506 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.456739] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.456774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.456882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.456946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de9de8a-4c0a-41a7-988f-e927d9085506',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.457625] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.457725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.457786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.457926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.457997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.458130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.458233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.458430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.458592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.458659] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.459390] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.459640] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.459714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.459849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.459922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.460069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.460190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.460230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.460340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.460404] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.461101] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.461205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.461294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.461443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.461513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.461648] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.461762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.461820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.461961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.462012] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.462839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.462943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.463008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.463150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.463248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.463388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.463474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.463532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.463661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.463725] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.464574] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.464729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.464785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.464892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.464964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.465099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.465185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.465238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.465372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.465435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.466105] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.466231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.466296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.466441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.466514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.466651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b763dde8-8a28-457b-bd0e-50c30206bee2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.466737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b763dde8-8a28-457b-bd0e-50c30206bee2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.466795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b763dde8-8a28-457b-bd0e-50c30206bee2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.466975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b763dde8-8a28-457b-bd0e-50c30206bee2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.467042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b763dde8-8a28-457b-bd0e-50c30206bee2',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.467808] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.467941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.468021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.468167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.468278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.468406] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9d1eac-b2e2-4c32-8a54-23a13889bd31 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.468498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9d1eac-b2e2-4c32-8a54-23a13889bd31" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.468549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9d1eac-b2e2-4c32-8a54-23a13889bd31" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.468723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9d1eac-b2e2-4c32-8a54-23a13889bd31" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.468789] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9d1eac-b2e2-4c32-8a54-23a13889bd31',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.481080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.481204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.481285] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.481478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.481561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.481742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.481835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.481894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.482082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.482121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.482177] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c61b63d-18fa-4fbd-b651-ed6a9bd62170 is going to be deleted. [ 2226.488772] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 856f8406-f39e-4bce-a94f-421561f6cabd [ 2226.488947] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.489058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.489128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.489339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.489443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.492749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.492854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.492916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.493078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.493157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.493336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.493422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.493487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.493625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.493695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.493776] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4801f783-8dbc-45ec-a773-4c5f10604f95 is going to be deleted. [ 2226.494676] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fb61bfc-b99b-4d58-81c0-efe9d197b506 [ 2226.494835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.494936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.495000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.495147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.495225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.519887] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.520106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.520106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.520317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.520409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.521928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.522057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.522128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.522315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.522401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.522497] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 105ab1e0-aa9d-412e-9840-c617dca8aede is going to be deleted. [ 2226.524765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.524900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.524955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.525121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.525207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.525299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c61b63d-18fa-4fbd-b651-ed6a9bd62170" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.528720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.528856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.528926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.529106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.529190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.529301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4801f783-8dbc-45ec-a773-4c5f10604f95" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.530443] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.530555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.530622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.530778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.530858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.531007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.531101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.531164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.531303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.531494] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.531577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.531632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.531774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.531851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.531931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.532024] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.536901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.537013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.537094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.537255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.537339] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.537512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.537609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.537797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.537958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.538037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.538124] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa91f3d7-2dd6-42f5-ad5c-5e8869447833 is going to be deleted. [ 2226.539048] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.539152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.539220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.539386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.539457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.539630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.539723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.539784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.539921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.539996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.540090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c221fa9-d7c5-4f9e-a059-1a11c92487e0 is going to be deleted. [ 2226.546285] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee9d1eac-b2e2-4c32-8a54-23a13889bd31 [ 2226.546481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.546599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.546668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.546850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.546937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.553660] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b763dde8-8a28-457b-bd0e-50c30206bee2 [ 2226.553660] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.553660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.553660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.553660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.553660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.563522] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.563735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.563735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.563935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.565175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.565320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.565320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.565469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.565552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.565767] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.565868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.565928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.566074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.566248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.566346] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.566408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.566561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.566622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.566700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.566781] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.567686] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.567792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.568107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.568107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.568107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.568421] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.568528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.568592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.568740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.568885] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.568980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.569042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.569180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.569256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.569368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.569571] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.569672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.569735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.569875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.569963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.570086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.570176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.570237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.570376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.570517] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.570604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.570664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.570796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.570869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.570949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.571032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.574226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.574341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.574409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.574569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.574647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.574796] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.574890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.574952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.575089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.575229] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.575319] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.575381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.575511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.575589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.575668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.575748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.576607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.576713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.576782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.576931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.577009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.577152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.577245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.577309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.577447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.577623] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.577692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.577734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.577866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.577940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.578019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.578101] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.579520] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.579631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.579699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.579847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.579925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.580095] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.580189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.580316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.580385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.580542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.580641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.580702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.580838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.580915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.580996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.581078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.584378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.584960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.585235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.585235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.585235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.585337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.585337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.585432] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.585485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.586231] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.586342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.586411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.586586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.586674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.586821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.586916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.586978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.587118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.587258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.587351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.587412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.587546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.587621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.587702] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.587779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.594779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.594779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.594779] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.594779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18eb7d56-dc9c-4516-b37c-4f4d855b4682: rpc.has_security_group_logging(os_id): False [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.597983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.598816] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.598929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.598999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.599167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.599248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.599412] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.599508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.599572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.599718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.599858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.599951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.600061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.600168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.600246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.600330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.600415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.604598] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.604742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.604813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.604993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.605100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.605205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c221fa9-d7c5-4f9e-a059-1a11c92487e0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.608086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.608218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.608306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.608486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.608572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.608666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa91f3d7-2dd6-42f5-ad5c-5e8869447833" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-105ab1e0-aa9d-412e-9840-c617dca8aede" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.612373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.612934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.613190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.613190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.613190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.613316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.613417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.613501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.613693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.613839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.613929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.613986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.614120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.614198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.614279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.614369] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.616805] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5dc1b16-b068-4af0-8edb-6a8c098bd113: rpc.has_security_group_logging(os_id): False [ 2226.617903] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.617964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.618001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.618153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.618252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.618420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.618513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.618574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.618716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.618857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.618946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.619006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.619137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.619245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.619352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.619484] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.619577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.619639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.619777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.619851] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.619992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.620096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.620156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.620293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.620431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.620524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.620584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.620717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.620792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.620873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.620958] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.621735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 2226.624352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.624467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.624535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.624692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.624771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.624920] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.625016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.625079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.625219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.625360] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.625451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.625509] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.625644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.625721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.625800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.625977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.626073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.626133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.626273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.626345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.626485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.626574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.626633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.626767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.626900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.626988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.627047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.627180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.627255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.627334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.627416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.628259] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.628366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.628435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.628587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.628666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.628813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.628930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.628997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.629140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.629284] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.629377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.629438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.629574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.629649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.629732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.629912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.630059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.630106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.630237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.630312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.630454] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.630544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.630601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.630736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.630871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.630960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.631018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.631187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.631264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.631344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.631426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.632233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2226.635075] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2226.636084] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518a0bec-8c5a-406d-bdb3-ca7657d7078f: rpc.has_security_group_logging(os_id): False [ 2226.638641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.638731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.639058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 2226.641825] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2226.644690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.644804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 is going to be deleted. [ 2226.646845] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00733a16-9d48-41eb-b0e1-9aaad9cc6253: rpc.has_security_group_logging(os_id): False [ 2226.648360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.648612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.651425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.651549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.654301] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.654410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.656945] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.657078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.657150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.657357] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.657453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.657597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9d1eac-b2e2-4c32-8a54-23a13889bd31" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.658309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.658451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.658526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.658697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.659188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.659371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b763dde8-8a28-457b-bd0e-50c30206bee2" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.660011] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.660170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.660245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.660406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.660490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.660620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-856f8406-f39e-4bce-a94f-421561f6cabd" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.664690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.664809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.664879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.665041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.665125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.665255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fb61bfc-b99b-4d58-81c0-efe9d197b506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.669279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.669381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.670754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.670853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.674013] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.674110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.681911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.682049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.683971] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2226.684450] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.684566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.685245] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2226.685654] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.685750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.692625] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2226.693079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.693199] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be deleted. [ 2226.694151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.694363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.718457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.718670] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.726441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.726638] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de9de8a-4c0a-41a7-988f-e927d9085506 is going to be deleted. [ 2226.727633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.727854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.759108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.759482] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.759615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.759685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.759894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.759977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.760190] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.760292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.760356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.760530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.760639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.760759] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.760837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.760899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.761038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.761115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.761207] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be updated. [ 2226.762344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.762520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.906737] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.906965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.923436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.923742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.923874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.923945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.924173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.924259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.924472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.924573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.924659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.924784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.924876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.925049] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.925126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.925191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.925369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.925480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.925522] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2226.926683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.926853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.949309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.949594] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.959622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.959922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2226.960039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2226.960112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.960323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2226.960411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2226.960510] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be updated. [ 2226.961643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2226.961820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.012286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.012595] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.012722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.012794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.013001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.013090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.013297] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.013406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.013471] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.013626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.013705] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.013893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.013973] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.014034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.014177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.014289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.014356] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 2227.015530] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.015700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.071765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.071996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.084627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.084932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.085062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.085138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.085337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.085417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.085608] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.085708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.085772] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.085921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.085997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.086208] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.086291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.086353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.086491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.086569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.086667] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2227.087825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.087995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.148565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.148737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.175644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.175871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.176010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.176111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.176327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.176417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.176641] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.176797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.176867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.177025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.177105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.177314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.177398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.177462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.177603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.177681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.177774] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2227.179001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.179164] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.236683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.236978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.237107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.237163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.237379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.237454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.237655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.237759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.237821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.237970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.238047] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.238279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.238418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.238418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.238552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.238626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.238720] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 2227.239914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.240097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.241911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.242071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.273610] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.273867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.276166] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.276347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.318421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.318794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.318896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.318968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.319217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.319320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.319431] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be updated. [ 2227.320685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.320872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.321027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.322011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.322180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.322269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.322388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.322550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.322700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.322830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.323704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.323863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.323949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.324086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de9de8a-4c0a-41a7-988f-e927d9085506" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.324639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.324803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.324880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.325004] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.325433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.325584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.325712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.326636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.326786] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.326919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.328017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.328227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.328366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.421146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2227.421873] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 2227.423590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2227.427152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: IN_PROGRESS for 2s [ 2227.433153] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: IN_PROGRESS for 2s [ 2227.434715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.434859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.434987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.435155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.435312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.469367] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2227.470080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.470227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.470300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.470529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.470693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.493951] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 2227.566421] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2227.567070] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2227.567230] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2227.567314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2227.567522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2227.567717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.594604] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: IN_PROGRESS for 2s [ 2229.436118] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 2229.436514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.437081] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2229.437286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.437912] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2229.438078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.438721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: SUCCESS [ 2229.438933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.444630] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: SUCCESS [ 2229.444795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.480652] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2229.480847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.503649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 2229.503807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2229.605537] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: SUCCESS [ 2229.605763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2231.433587] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2231.433965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2236.434940] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2236.435258] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2241.435905] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2241.436236] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2242.527240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-5112e606-af69-46ff-9e69-59dee92ef2b6 req-a03e09a6-9942-4eb6-901d-4f348fce3f88 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2242.527765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2242.528121] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2242.528276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2242.528547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2242.528547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2242.528631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2242.528814] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2242.528933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2242.529007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2242.529201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2242.529431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2242.529534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2242.529579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2242.529732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2242.529812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2242.529911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2242.537748] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2242.548431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2242.560447] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2242.560602] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2242.560701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2242.564048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2242.564048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2242.564048] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2242.593123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2242.593320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2242.593320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2242.593608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2242.593677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2242.604670] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2244.615630] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2244.615994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2247.528952] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2247.529235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2248.022127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2b976214-04e8-42af-96fa-96768551d224 req-f0bd5e60-d603-4eb9-94bc-ded017a6eacc tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2248.022580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2248.022639] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.022787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.022992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.023029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.023092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.023354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.023354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.023486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.023521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.023644] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.023725] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.023779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.023915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.023993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.024106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.031431] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.045914] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.052512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.052676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.052721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.052931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.053023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.053112] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2248.083992] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.084170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.084238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.084442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.084590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.093018] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2248.347162] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.347358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.347492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.347971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.348162] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.348580] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-842 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.348762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.348892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.349141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.349448] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.349614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.349738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.349950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.350098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.350336] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-842" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.350637] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.350816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.350942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.351153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.351293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.351538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-2668459e-5ce9-4e87-95fb-d7825dd5bc05 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.351693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.351816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.352108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.352344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2668459e-5ce9-4e87-95fb-d7825dd5bc05',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.367087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.367291] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.367501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.367771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.367925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.368095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 2668459e-5ce9-4e87-95fb-d7825dd5bc05 not found, creating... [ 2248.368397] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.368562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.368684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.368903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.369046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.369342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.369498] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.369622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.369829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.369966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.370108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 2668459e-5ce9-4e87-95fb-d7825dd5bc05 is going to be created. [ 2248.390888] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.391099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.391207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.391478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.391715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.391937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.679305] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2b976214-04e8-42af-96fa-96768551d224 req-ed171684-1046-4595-8306-c8ab722941bf service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 2248.679575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2b976214-04e8-42af-96fa-96768551d224 req-ed171684-1046-4595-8306-c8ab722941bf service neutron] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2248.679611] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2b976214-04e8-42af-96fa-96768551d224 req-ed171684-1046-4595-8306-c8ab722941bf service neutron] Enqueued Resource ID: 2668459e-5ce9-4e87-95fb-d7825dd5bc05 with Priority: HIGHEST for action port [ 2248.680203] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_rules [ 2248.680324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2248.680428] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2668459e-5ce9-4e87-95fb-d7825dd5bc05 with Priority: HIGHEST for action port [ 2248.680918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.681078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.681155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.681380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.681476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.681634] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.682023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.682093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.682278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.682329] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.683346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.683457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.683457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.683583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.683659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.683794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.683890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.684069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.684173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.684220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.684393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.684592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.684747] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-2668459e-5ce9-4e87-95fb-d7825dd5bc05 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.684835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.684871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.685044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.685113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2668459e-5ce9-4e87-95fb-d7825dd5bc05',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2248.705946] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2668459e-5ce9-4e87-95fb-d7825dd5bc05 with status ACTIVE [ 2248.706174] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.706278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.706354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.706614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.707056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.707056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.707186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.707186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.707341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.707417] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.709765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.709892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2248.709937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2248.710096] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2248.710172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2248.710321] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2248.710404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2249.101137] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2249.101384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2249.101384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2249.101554] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2249.101647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2249.101748] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2668459e-5ce9-4e87-95fb-d7825dd5bc05 is going to be updated. [ 2249.123818] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2249.124076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2249.124076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2249.124191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2249.124318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2249.124479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2668459e-5ce9-4e87-95fb-d7825dd5bc05" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2250.103870] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2250.104288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2250.104338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2250.104550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2250.104753] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2250.104881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2250.104950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2250.105115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2250.105204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2250.105309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2250.115525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2250.125688] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2250.134365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2250.134615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2250.134615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2250.134994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2250.135107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2250.135215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2250.165471] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2250.165696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2250.165696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2250.165896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2250.166053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2250.176054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2252.188315] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2252.188649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.188706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.188919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.189109] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.189226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.189290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.189428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.189512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.189600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.189690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2252.199127] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.199293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.199343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.199492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.199576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.199738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.199841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.199905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.200058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.200207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.200303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.200366] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.200538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.200621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.200690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.200845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.200936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.200996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.201133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.201207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.201352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.201443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.201503] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.201636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.201771] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.201862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.201922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.202051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.202124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.202207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.202296] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2252.208602] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 2252.228087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.228333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.228385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.228549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.228642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.228856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.228955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.229011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.229155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.229251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.229446] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.229540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.229593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.229733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.229807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.229982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.230076] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.230131] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.230263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.230337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.230439] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2252.287990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.288283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2252.288283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2252.288462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2252.288625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2252.302237] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2253.682006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2253.682420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2254.317703] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2254.317982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2258.683058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2258.683372] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2263.684466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2263.684466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2268.686018] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2268.686018] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2273.687679] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2273.688025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2278.689094] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2278.689432] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2283.690911] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2283.691372] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2288.692176] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2288.692494] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2291.464201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-b98fa270-ddce-4186-a57d-f8ff965b8ae9 req-8b9855b9-a8c7-4247-9cc0-7967f4943880 tempest-AttachVolumeNegativeTest-648215624 tempest-AttachVolumeNegativeTest-648215624-project-member] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 2291.464201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGHEST for action security_group_members [ 2291.464201] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.464201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.464201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.464201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.464710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2291.464710] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.464710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.464898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.465017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.465238] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.465396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.465500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.466000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.466000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2291.466000] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2291.476359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.476520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.476590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.476722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.476807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2291.476981] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.477077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.477132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.477277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.477356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2291.477449] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be updated. [ 2291.513821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2291.513980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2291.514052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2291.514270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2291.514424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2291.523896] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: IN_PROGRESS for 2s [ 2293.535888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 in Status: SUCCESS [ 2293.536276] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 deletion is rescheduled due to dependency. [ 2293.536276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2296.464157] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2296.464499] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2301.465492] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2301.465858] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2306.466531] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2306.466881] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2311.468072] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2311.468412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2316.469253] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2316.469504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2321.470467] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2321.470773] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2326.471385] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2326.471778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2331.472427] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2331.472771] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2336.473150] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2336.473585] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2339.015380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2c573800-bd69-4daf-af8f-a9ac78ce94ae req-ead772bc-259d-42f5-b039-2ab68e4db49e tempest-ImagesTestJSON-226226016 tempest-ImagesTestJSON-226226016-project-member] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 2339.015380] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGHEST for action security_group_members [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2339.015380] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.026536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2339.026536] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be updated. [ 2339.057485] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2339.057649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2339.057748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2339.058008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2339.058137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2339.073476] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: IN_PROGRESS for 2s [ 2341.084820] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f in Status: SUCCESS [ 2341.085148] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f deletion is rescheduled due to dependency. [ 2341.085309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2344.013917] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2344.014378] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2347.522113] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-15772db2-d8b0-4b2a-901c-1ca94b09996f req-cf10a404-6647-478a-ae7b-79d67e79d621 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2347.522113] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2347.522113] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2347.529712] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2347.539470] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2347.549024] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2347.549424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2347.549659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2347.549984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2347.550239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2347.550471] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2347.582358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2347.582896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2347.583132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2347.583469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2347.583761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2347.593504] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-733 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.067996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.068922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.069513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-988fa07f-eb04-4e1d-843c-f2f773b9314c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.069513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.069513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.069513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.069513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988fa07f-eb04-4e1d-843c-f2f773b9314c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2348.086277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.086659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.086968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.087305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.087524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.087734] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 988fa07f-eb04-4e1d-843c-f2f773b9314c not found, creating... [ 2348.088069] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.088400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.088598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.088886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.089087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.089588] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.089808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.089998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.090266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.090462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.090655] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 988fa07f-eb04-4e1d-843c-f2f773b9314c is going to be created. [ 2348.113094] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.113445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.113639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.113961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.114258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.114549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.322564] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-15772db2-d8b0-4b2a-901c-1ca94b09996f req-d713a105-ac58-4c30-b7ef-b10c3059f326 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 2348.322863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-15772db2-d8b0-4b2a-901c-1ca94b09996f req-d713a105-ac58-4c30-b7ef-b10c3059f326 service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2348.323068] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-15772db2-d8b0-4b2a-901c-1ca94b09996f req-d713a105-ac58-4c30-b7ef-b10c3059f326 service neutron] Enqueued Resource ID: 988fa07f-eb04-4e1d-843c-f2f773b9314c with Priority: HIGHEST for action port [ 2348.323726] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 2348.323919] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2348.324081] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988fa07f-eb04-4e1d-843c-f2f773b9314c with Priority: HIGHEST for action port [ 2348.324422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.324676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.324724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.324983] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.325113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.325320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.325473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.325643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.325957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.326096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2348.327502] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.327722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.327836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.328066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.328200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.328457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.328593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.329347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.329347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.329347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.329347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.329347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.329604] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-988fa07f-eb04-4e1d-843c-f2f773b9314c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.329734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.329769] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.329950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.330084] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988fa07f-eb04-4e1d-843c-f2f773b9314c',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2348.346984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.346984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.346984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.347475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.347475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.348185] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.348185] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.350444] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 988fa07f-eb04-4e1d-843c-f2f773b9314c with status ACTIVE [ 2348.350730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.350897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.351005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.351245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.351392] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.351607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.351750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.351849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.352069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.352191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.717721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.718135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.718135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.718440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.718598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.718746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 988fa07f-eb04-4e1d-843c-f2f773b9314c is going to be updated. [ 2348.738416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2348.738723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2348.738849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2348.739129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2348.739430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2348.739676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988fa07f-eb04-4e1d-843c-f2f773b9314c" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2349.603738] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2349.603954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2349.604173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2349.604414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2349.604621] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2349.604742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2349.604809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2349.604963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2349.605048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2349.605143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2349.614251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2349.621949] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2349.628078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2349.628213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2349.628311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2349.628521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2349.628615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2349.628714] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2349.655508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2349.655682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2349.655723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2349.655908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2349.656075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2349.664528] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2351.676129] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2351.676500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.676500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.676726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.676921] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.677038] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.677111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.677267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.677353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.677439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.677527] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2351.687177] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.687313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.687361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.687515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.687596] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.687752] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.687850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.687913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.688071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.688215] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.688329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.688394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.688537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.688615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.688700] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.688854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.688946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.689006] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.689141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.689213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.689354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.689444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.689504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.689636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.689768] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.689855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.689913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.690042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.690115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.690195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.690279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2351.696570] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2351.714912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.715072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.715122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.715274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.715361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.715548] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.715665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.715731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.715876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.715954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.716165] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.716279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.716350] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.716491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.716566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.716762] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.716856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.716919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.717056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.717130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.717213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2351.774206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2351.774361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2351.774427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2351.774612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2351.774766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2351.792999] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2353.325702] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2353.325950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2353.807756] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2353.808023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2358.326798] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2358.327183] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2363.328127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2363.328421] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2368.329465] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2368.329835] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2373.331105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2373.331400] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2378.333056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2378.333432] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2383.333831] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2383.334141] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2386.240985] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c31fb4d3-6e0a-4618-bb40-bdf919af2986 None None] Enqueued Resource ID: 068a91ba-1c2b-459c-bfb4-ed861a04f181 with Priority: HIGHEST for action port [ 2386.241283] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068a91ba-1c2b-459c-bfb4-ed861a04f181 with Priority: HIGHEST for action port [ 2386.241874] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2386.242012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2386.242082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2386.242296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2386.242386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2386.242537] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-068a91ba-1c2b-459c-bfb4-ed861a04f181 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2386.242634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-068a91ba-1c2b-459c-bfb4-ed861a04f181" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2386.242698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-068a91ba-1c2b-459c-bfb4-ed861a04f181" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2386.242890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-068a91ba-1c2b-459c-bfb4-ed861a04f181" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2386.242970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('068a91ba-1c2b-459c-bfb4-ed861a04f181',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2386.270648] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 068a91ba-1c2b-459c-bfb4-ed861a04f181 [ 2386.270856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2386.270957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2386.271032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2386.271343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2386.271400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2386.271439] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:068a91ba-1c2b-459c-bfb4-ed861a04f181 already deleted. [ 2386.271520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-068a91ba-1c2b-459c-bfb4-ed861a04f181" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2387.677681] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-70559087-2c80-4792-83f4-899e5bf27ed8 req-db674b07-785d-4566-947f-5034b68b9cbe tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2387.678189] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2387.678534] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2387.678652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2387.678720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2387.678951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2387.679041] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2387.679195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2387.679294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2387.679372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2387.679532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2387.679672] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2387.679762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2387.679823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2387.679960] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2387.680048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2387.680136] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2387.700839] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2387.717755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2387.738919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2387.739061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2387.739133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2387.739397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2387.739611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2387.739611] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2387.775790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2387.775985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2387.776043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2387.776274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2387.776438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2387.787386] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2388.435074] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-7428f906-9b7c-4b16-9c27-52319b00ba65 None None] Enqueued Resource ID: f664d396-5e6f-4247-9c5c-f9d56a230902 with Priority: HIGHEST for action port [ 2388.435333] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f664d396-5e6f-4247-9c5c-f9d56a230902 with Priority: HIGHEST for action port [ 2388.435994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.436188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.436258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.436459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.436540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2388.436701] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f664d396-5e6f-4247-9c5c-f9d56a230902 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.436839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f664d396-5e6f-4247-9c5c-f9d56a230902" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.436931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f664d396-5e6f-4247-9c5c-f9d56a230902" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.437172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f664d396-5e6f-4247-9c5c-f9d56a230902" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.437251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f664d396-5e6f-4247-9c5c-f9d56a230902',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2388.457441] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f664d396-5e6f-4247-9c5c-f9d56a230902 [ 2388.457753] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.457956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.458074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.458371] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.458656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2388.458862] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f664d396-5e6f-4247-9c5c-f9d56a230902 already deleted. [ 2388.459091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f664d396-5e6f-4247-9c5c-f9d56a230902" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2388.793454] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-715380a7-9223-4a60-800f-4004b4387a91 None None] Enqueued Resource ID: 8de92a70-2568-49ab-94ef-a2b6205fd18f with Priority: HIGHEST for action port [ 2388.793790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de92a70-2568-49ab-94ef-a2b6205fd18f with Priority: HIGHEST for action port [ 2388.794412] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.794536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.794605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.794801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.794885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2388.795041] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de92a70-2568-49ab-94ef-a2b6205fd18f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.795135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de92a70-2568-49ab-94ef-a2b6205fd18f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.795197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de92a70-2568-49ab-94ef-a2b6205fd18f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.795385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de92a70-2568-49ab-94ef-a2b6205fd18f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.795463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de92a70-2568-49ab-94ef-a2b6205fd18f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2388.835359] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8de92a70-2568-49ab-94ef-a2b6205fd18f [ 2388.835559] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2388.835683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2388.835752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2388.835954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2388.836070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2388.836165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8de92a70-2568-49ab-94ef-a2b6205fd18f already deleted. [ 2388.836248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de92a70-2568-49ab-94ef-a2b6205fd18f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2389.800899] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2389.800899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.577618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-32c1d477-16e6-4e21-be4e-3ea1c0ea6e86 None None] Enqueued Resource ID: 5357382e-4d9f-4a89-86ef-26f1533f8a35 with Priority: HIGHEST for action port [ 2390.577877] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5357382e-4d9f-4a89-86ef-26f1533f8a35 with Priority: HIGHEST for action port [ 2390.578493] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.578622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.578691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.578891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.578976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.579126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5357382e-4d9f-4a89-86ef-26f1533f8a35 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.579219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5357382e-4d9f-4a89-86ef-26f1533f8a35" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.579283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5357382e-4d9f-4a89-86ef-26f1533f8a35" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.579533] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5357382e-4d9f-4a89-86ef-26f1533f8a35" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.579628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5357382e-4d9f-4a89-86ef-26f1533f8a35',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2390.589095] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5357382e-4d9f-4a89-86ef-26f1533f8a35 [ 2390.589306] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.590066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.590066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.590066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.590066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.590066] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5357382e-4d9f-4a89-86ef-26f1533f8a35 already deleted. [ 2390.590066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5357382e-4d9f-4a89-86ef-26f1533f8a35" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.766806] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-81a1e20d-e1d2-435e-acc6-26bd251b334f req-126094dc-bca9-41c4-80c2-34d443b1a088 tempest-ServersNegativeTestMultiTenantJSON-343759983 tempest-ServersNegativeTestMultiTenantJSON-343759983-project-member] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2390.767318] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2390.767631] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.767753] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.767821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.768017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.768102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.768287] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.768389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.768451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.768665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.768854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.768909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.768955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.772982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.772982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.772982] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2390.777794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.777911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.777979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.778150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.778232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.778441] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2390.778538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2390.778597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2390.778744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2390.778817] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2390.778898] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab already deleted. [ 2390.778971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.108974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.109292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.109356] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.109936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.110093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.110352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-457 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.110510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-457" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.110628] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-457" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.111279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-457" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.111279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.111279] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.111467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.111604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.111743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.111885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-457" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.112149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.112302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.112419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.112618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.112747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.112979] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-b29c06d2-31e1-4987-a3d5-904f79182785 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.113127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.113243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.113474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.113607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b29c06d2-31e1-4987-a3d5-904f79182785',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.130978] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.131183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.131310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.131589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.131743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.131898] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port b29c06d2-31e1-4987-a3d5-904f79182785 not found, creating... [ 2391.132212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.132384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.132511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.132731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.132875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.133162] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.133324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.133449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.133658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.133797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.133942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: b29c06d2-31e1-4987-a3d5-904f79182785 is going to be created. [ 2391.153230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.153524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.153696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.154002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.154284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.154552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.374000] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-81a1e20d-e1d2-435e-acc6-26bd251b334f req-8b3b2160-0f6b-4ec2-86d8-5b95c5e84be2 service neutron] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_rules [ 2391.374229] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-81a1e20d-e1d2-435e-acc6-26bd251b334f req-8b3b2160-0f6b-4ec2-86d8-5b95c5e84be2 service neutron] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2391.374411] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-81a1e20d-e1d2-435e-acc6-26bd251b334f req-8b3b2160-0f6b-4ec2-86d8-5b95c5e84be2 service neutron] Enqueued Resource ID: b29c06d2-31e1-4987-a3d5-904f79182785 with Priority: HIGHEST for action port [ 2391.374874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_rules [ 2391.375011] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2391.375104] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b29c06d2-31e1-4987-a3d5-904f79182785 with Priority: HIGHEST for action port [ 2391.375395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.375536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.375601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.375798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.375878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.376089] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.376209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.376400] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.378775] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.379942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.380513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.380513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.380513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.380513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.380513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.380824] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-b29c06d2-31e1-4987-a3d5-904f79182785 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.380824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.380824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.380824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.381087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b29c06d2-31e1-4987-a3d5-904f79182785',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.392461] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.411544] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.411712] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.411784] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.411968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.412109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.412248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.412364] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.416258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2391.425259] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b29c06d2-31e1-4987-a3d5-904f79182785 with status ACTIVE [ 2391.425466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.425590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.425656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.425858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.425950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.426132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.426235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.426305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.426439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.426519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.427733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.427846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.427906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.428092] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.428175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.428282] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab is going to be created. [ 2391.465226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.465588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.465588] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.465754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.465813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.475216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: UNINITIALIZED for 2s [ 2391.768705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.768945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.768945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.769129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.769224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.769364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b29c06d2-31e1-4987-a3d5-904f79182785 is going to be updated. [ 2391.791975] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2391.792095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2391.792214] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2391.792370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2391.792521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2391.792687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b29c06d2-31e1-4987-a3d5-904f79182785" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.485260] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: SUCCESS [ 2393.485535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.485650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.485889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.486086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.486204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.486274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.486428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.486511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.486704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.486749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2393.495230] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.495433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.495732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.495897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.496114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.496334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.496486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.496590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.496830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.497008] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.497141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.497243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.497428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.497555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.497678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.497873] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.498027] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.498204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.498329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.498452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.498639] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.498781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.498879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.499151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.499348] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.499519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.499623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.499806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.499948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.500079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.500205] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2393.507366] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 334df093-4d11-4058-a3c7-b9eeaaefc7ab: rpc.has_security_group_logging(os_id): False [ 2393.524812] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.525030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.525141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.525386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.525519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.525750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.525915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.526014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.526203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.526324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.526554] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.526693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.526789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.526963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.527091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.527332] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.527473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.527570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.527748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.527864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.527984] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab is going to be created. [ 2393.581388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2393.581636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2393.581756] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2393.582023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2393.582273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2393.593167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: IN_PROGRESS for 2s [ 2395.606696] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: SUCCESS [ 2395.606984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2395.823928] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-14b03297-e0a3-4eb9-a54e-dfade91c4393 req-39fcc125-c9bd-4229-8cc5-4fc682159fa8 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2395.824502] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2395.824819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2395.824938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2395.825002] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2395.825192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2395.825271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2395.825416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2395.825506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2395.825563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2395.825713] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2395.825846] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2395.825937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2395.825992] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2395.826130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2395.826269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2395.826408] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2395.839877] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2395.852371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2395.866790] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2395.866939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2395.867009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2395.867213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2395.867302] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2395.867398] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2395.895516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2395.895676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2395.895746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2395.895959] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2395.896234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2395.905874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2396.172848] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.173055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.173227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.173507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.173657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.173942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-445 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.174130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.174317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.174507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.174799] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.174998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.175126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.175342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.175482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.175630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.175932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.176143] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.176306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.176542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.176685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.176924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-5d86209a-a315-4be5-a3b4-3a6fa932d70a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.177080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.177199] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.177545] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.177699] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d86209a-a315-4be5-a3b4-3a6fa932d70a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2396.192898] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.193169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.193323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.193572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.193780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.193988] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 5d86209a-a315-4be5-a3b4-3a6fa932d70a not found, creating... [ 2396.194258] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.194423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.194557] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.194760] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.194933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.195342] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.195744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.195744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.195991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.196117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.196278] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 5d86209a-a315-4be5-a3b4-3a6fa932d70a is going to be created. [ 2396.218426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.218636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.218767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.219030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.219284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.219586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.443421] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-14b03297-e0a3-4eb9-a54e-dfade91c4393 req-f4ba48d6-dc61-4a5c-9f64-7192a7e0e9a9 service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2396.443618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-14b03297-e0a3-4eb9-a54e-dfade91c4393 req-f4ba48d6-dc61-4a5c-9f64-7192a7e0e9a9 service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2396.443765] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-14b03297-e0a3-4eb9-a54e-dfade91c4393 req-f4ba48d6-dc61-4a5c-9f64-7192a7e0e9a9 service neutron] Enqueued Resource ID: 5d86209a-a315-4be5-a3b4-3a6fa932d70a with Priority: HIGHEST for action port [ 2396.444232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2396.444367] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2396.444468] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d86209a-a315-4be5-a3b4-3a6fa932d70a with Priority: HIGHEST for action port [ 2396.444749] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.444876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.444945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.445145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.445231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.445386] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.445484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.445539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.445687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.445766] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2396.446638] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.446742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.446809] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.446962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.447040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.447180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.447289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.447444] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.447540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.447601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.447740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.447813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.447950] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d86209a-a315-4be5-a3b4-3a6fa932d70a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.448051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.448114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.448292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.448378] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d86209a-a315-4be5-a3b4-3a6fa932d70a',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2396.464926] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.465060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.465125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.465323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.465408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.466166] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.466166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.469501] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d86209a-a315-4be5-a3b4-3a6fa932d70a with status ACTIVE [ 2396.469680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.469788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.469857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.470035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.470121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.470288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.470384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.470448] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.470711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.470795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.870656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.871042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.871042] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.871123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.871209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.871320] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d86209a-a315-4be5-a3b4-3a6fa932d70a is going to be updated. [ 2396.891817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2396.892032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2396.892032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2396.892263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2396.892401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2396.892572] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d86209a-a315-4be5-a3b4-3a6fa932d70a" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2397.915966] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2397.916363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2397.916363] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2397.916598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2397.916763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2397.916885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2397.916948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2397.917098] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2397.917184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2397.917277] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2397.924952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2397.932305] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2397.938312] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2397.938454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2397.938504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2397.938742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2397.938836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2397.938932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2397.968579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2397.968579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2397.968579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2397.968917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2397.968917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2397.977643] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2399.989228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2399.989580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2399.989580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2399.989788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2399.989980] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2399.990099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2399.990165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2399.990312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2399.990398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2399.990500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2399.990608] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2399.999541] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2399.999726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2399.999726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2399.999893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2399.999975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.000157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.000261] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.000322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.000467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.000610] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.000703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.000758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.000893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.000970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.001052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.001200] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.001290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.001377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.001526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.001600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.001742] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.001832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.001888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.002022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.002157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.002246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.002304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.002436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.002513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.002593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.002723] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2400.009306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2400.028563] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.028849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.028849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.029338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.029338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.029540] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.029540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.029540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.029758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.029758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.029928] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.030020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.030109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.030216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.030365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.030517] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.030620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.030620] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.030743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.030810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.030895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2400.087268] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2400.087562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2400.087562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2400.087694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2400.087824] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2400.101058] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2401.445823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2401.446165] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2402.115077] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2402.115329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2406.447241] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2406.447590] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2411.448439] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2411.448754] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2416.450026] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2416.450409] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2421.451389] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2421.451874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2426.453460] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2426.453460] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2429.829186] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:7 completed [ 2429.829500] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:8 started [ 2431.454224] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2431.454622] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2436.455566] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2436.455856] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2438.091966] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2e21fb24-0ac9-492b-b56c-7fc748f0c1da req-74751980-c5a4-4a49-ba6c-bc74699cdcb0 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2438.092506] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2438.092847] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2438.092974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2438.093025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2438.093226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2438.093293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2438.093435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2438.093536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2438.093595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2438.093740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2438.094061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2438.094175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2438.094242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2438.094412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2438.094499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2438.094590] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2438.102755] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2438.115728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2438.125606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2438.125741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2438.125926] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2438.126028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2438.126116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2438.126235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2438.166892] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2438.167046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2438.167121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2438.167337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2438.167490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2438.179354] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2440.192438] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2440.192438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2443.093645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2443.094026] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2448.095114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2448.095484] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2453.096083] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2453.096502] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2458.097793] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2458.098159] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2461.707097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2461.707472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2461.707472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2461.707568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2461.707601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2461.707785] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2461.707886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2461.707951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2461.708116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2461.708222] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2461.716415] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2461.723322] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2461.729503] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2461.729622] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2462.394454] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.394621] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.394683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.394881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.408076] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2462.408601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.409580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2462.447632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.447850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.447850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.448046] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.460626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.461461] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:6. [ 2462.461554] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378', '04c13508-87af-41b6-87ad-6357e426c059', '01cd1192-3777-4f83-98f1-cca32f6277c0', '838ac9b9-c73d-45ee-8871-c6d7b8673918', '317fd6c1-05df-48c2-ae75-1966e439fae0', '317f886a-d93c-4fc5-8369-829901ec71b7'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2462.461647] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2462.485763] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.485961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.485961] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.486182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.486650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.486790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2462.531788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.532019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.532019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.532203] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.532439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.532627] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2462.577326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.577463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.577538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.577751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.577929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.578110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:9. [ 2462.578197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b5dc1b16-b068-4af0-8edb-6a8c098bd113', '518a0bec-8c5a-406d-bdb3-ca7657d7078f', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', '334df093-4d11-4058-a3c7-b9eeaaefc7ab', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', '00733a16-9d48-41eb-b0e1-9aaad9cc6253', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488', '18eb7d56-dc9c-4516-b37c-4f4d855b4682'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2462.578270] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2462.597080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.597260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.597303] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.597479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.597566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.597671] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2462.597741] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2462.597810] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2462.646653] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.646812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.646873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.647433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.647898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.648082] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2462.648163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2462.648608] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2462.648685] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Ports [ 2462.648776] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378 with Priority: HIGH for action port [ 2462.648861] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04c13508-87af-41b6-87ad-6357e426c059 with Priority: HIGH for action port [ 2462.648929] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01cd1192-3777-4f83-98f1-cca32f6277c0 with Priority: HIGH for action port [ 2462.648990] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 838ac9b9-c73d-45ee-8871-c6d7b8673918 with Priority: HIGH for action port [ 2462.649048] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 317fd6c1-05df-48c2-ae75-1966e439fae0 with Priority: HIGH for action port [ 2462.649110] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 317f886a-d93c-4fc5-8369-829901ec71b7 with Priority: HIGH for action port [ 2462.649178] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 9/9 resources of Type:Security Group Rules [ 2462.649240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2462.649674] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 2462.649778] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2462.649846] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2462.649910] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2462.649971] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2462.650029] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_rules [ 2462.650087] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2462.650145] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2462.650216] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2462.650311] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2462.650470] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.650695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.650833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.651030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.651111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.651321] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.651426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.651489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.651656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.651733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.651900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.652015] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.652114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.652288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.652385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.652558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.652651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.652707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.652841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.652913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.653077] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.653167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.653330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.653379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.653408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.653572] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.653662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.653717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.653847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.653918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.654080] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.654368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.654368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.654368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.654462] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.654561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.654651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.654707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.654838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.654907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.655067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.655172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.655206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.655333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.655419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.655588] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.655689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.655735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.655861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.655930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.656104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.656194] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.656249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.656373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.656445] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.656605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.656691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.656748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.656875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.656945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.657104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.657191] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.657251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.657374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.657446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.657605] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.657693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.657746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.657874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.657946] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.658133] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.658189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.658246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.658412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.658488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.658651] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.658736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.658790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.658919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.658990] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.659151] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.659238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.659308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.659421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.659491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.659655] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.659738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.659792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.659906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.659977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.660152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.660241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.660295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.660425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.660495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.660670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.660803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.660803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.660956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.661030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.661126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.661226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.661281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.661579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.661579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.661715] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.661789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.661842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.661936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.661997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.662690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.663135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.663135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.663135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.663286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.663355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.663355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.663599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.663599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.663700] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.663778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.663831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.663962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.664084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.664330] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.664470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.664564] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.664768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.664907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.665090] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2462.665176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2462.665229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2462.665369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2462.665473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2462.665544] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:2 [ 2462.665609] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 2 of least updated resources [ 2462.665701] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_members [ 2462.665821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_members [ 2462.665921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.099510] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2463.099857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=17], Jobs=0 [ 2463.099857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378 with Priority: HIGH for action port [ 2463.099857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01cd1192-3777-4f83-98f1-cca32f6277c0 with Priority: HIGH for action port [ 2463.099969] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2463.100044] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2463.100080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 with Priority: HIGH for action security_group_members [ 2463.100232] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2463.100296] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 with Priority: HIGH for action security_group_members [ 2463.100352] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_rules [ 2463.100452] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2463.100535] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2463.100653] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2463.100766] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2463.100856] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 317f886a-d93c-4fc5-8369-829901ec71b7 with Priority: HIGH for action port [ 2463.100946] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f with Priority: HIGH for action security_group_rules [ 2463.101033] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 317fd6c1-05df-48c2-ae75-1966e439fae0 with Priority: HIGH for action port [ 2463.101122] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c13508-87af-41b6-87ad-6357e426c059 with Priority: HIGH for action port [ 2463.101210] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 838ac9b9-c73d-45ee-8871-c6d7b8673918 with Priority: HIGH for action port [ 2463.101568] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.101704] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.101771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.101986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.102069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.102227] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.102323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.102385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.102701] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.102781] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.104264] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.104382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.104454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.104685] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.104767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.104912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-01cd1192-3777-4f83-98f1-cca32f6277c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.105005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01cd1192-3777-4f83-98f1-cca32f6277c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.105067] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01cd1192-3777-4f83-98f1-cca32f6277c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.105255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01cd1192-3777-4f83-98f1-cca32f6277c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.105333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01cd1192-3777-4f83-98f1-cca32f6277c0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.106729] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.106827] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.106893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.107091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.107172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.107316] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.107409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.107470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.107609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.107681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.108765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.108871] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.108939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.109089] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.109166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.109352] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.109452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.109575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.109730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.109802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.111112] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.111262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.111338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.111491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.111569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.111711] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e71d03b6-2bab-4f24-a6ee-b9da8e938815 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.111803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.111865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.112010] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.112150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.112265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.112314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.112776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.112866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.112952] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e71d03b6-2bab-4f24-a6ee-b9da8e938815',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.113938] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.114048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.114115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.114265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.114342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.114483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.114574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.114653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.114787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.114862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.115804] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.115913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.115979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.116140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.116216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.116375] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dccfe94-a28c-458f-a44d-bf0826c447a8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.116469] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.116515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.116651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.116786] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.116878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.116937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.117071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.117147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.117226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dccfe94-a28c-458f-a44d-bf0826c447a8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.118166] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.118289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.118393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.118525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.118603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.118746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.118840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.118902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.119040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.119204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.119990] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.120114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.120182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.120334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.120414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.120554] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.120648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.120708] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.120843] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.120912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.121757] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.121868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.121935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.122080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.122189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.122334] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.122427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.122488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.122623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.122691] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.123956] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.124080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.124169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.124297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.124379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.124538] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.124632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.124694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.124832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.124901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.125835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.125945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.126012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.126158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.126234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.126373] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.126465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.126526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.126662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.126732] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.127708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.127820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.127888] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.128066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.128140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.128286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-317f886a-d93c-4fc5-8369-829901ec71b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.128393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-317f886a-d93c-4fc5-8369-829901ec71b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.128457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-317f886a-d93c-4fc5-8369-829901ec71b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.128650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-317f886a-d93c-4fc5-8369-829901ec71b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.128721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('317f886a-d93c-4fc5-8369-829901ec71b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.129697] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.129808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.129876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.130026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.130102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.130242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.130333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.130416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.130559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.130632] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518a0bec-8c5a-406d-bdb3-ca7657d7078f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.131565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.131678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.131746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.131894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.131972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.132188] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-317fd6c1-05df-48c2-ae75-1966e439fae0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.132284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-317fd6c1-05df-48c2-ae75-1966e439fae0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.132349] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-317fd6c1-05df-48c2-ae75-1966e439fae0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.132522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-317fd6c1-05df-48c2-ae75-1966e439fae0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.132594] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('317fd6c1-05df-48c2-ae75-1966e439fae0',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.133609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.133722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.133790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.133939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.134017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.134155] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-04c13508-87af-41b6-87ad-6357e426c059 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.134245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04c13508-87af-41b6-87ad-6357e426c059" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.134308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04c13508-87af-41b6-87ad-6357e426c059" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.134699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04c13508-87af-41b6-87ad-6357e426c059" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.134773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04c13508-87af-41b6-87ad-6357e426c059',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.135795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.135907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.135985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.136134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.136228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.136381] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-838ac9b9-c73d-45ee-8871-c6d7b8673918 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.136479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-838ac9b9-c73d-45ee-8871-c6d7b8673918" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.136534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-838ac9b9-c73d-45ee-8871-c6d7b8673918" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.136711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-838ac9b9-c73d-45ee-8871-c6d7b8673918" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.136932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('838ac9b9-c73d-45ee-8871-c6d7b8673918',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.138748] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378 [ 2463.138912] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.139018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.139085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.139254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.139365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.148906] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.149054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.149147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.149343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.149437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.149634] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.149731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.149789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.150254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.150372] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.150469] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e71d03b6-2bab-4f24-a6ee-b9da8e938815 is going to be deleted. [ 2463.167831] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.167977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.168085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.168334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.168412] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.168585] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.168689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.168752] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.170892] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.171071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.171182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.171249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.171410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.171499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.171585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.171708] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.174108] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.174221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.174288] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.174447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.174526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.174674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.174856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.174856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.174962] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.175157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.175252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.175314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.175455] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.175532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.175614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.175696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.181308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.181420] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.181489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.181651] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.181733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.181880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.181976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.182040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.182179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.182320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.182475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.182532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.182669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.182759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.182861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.182949] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.193562] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.193840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.193919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.194373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.194543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.194730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.194835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.194893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.195137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.195201] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.195270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.195324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.195458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.195541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.195622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.195707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.197539] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.197653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.197723] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.197883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.197972] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.198064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e71d03b6-2bab-4f24-a6ee-b9da8e938815" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.200078] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.200189] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.200238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.200386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.200566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.200737] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.200836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.200899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.201045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.201186] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.201310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.201379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.201524] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.201601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.201684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.201833] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.201951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.202007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.202109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.202180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.202569] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.202676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.202741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.202885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.203064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.203152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.203236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.203382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.203461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.203542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.203627] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.204878] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.204989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.205058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.205281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.205281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.205423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.205519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.205582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.205722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.205862] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.205957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.206018] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.206152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.206270] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.206355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.206506] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.206598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.206660] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.206800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.206873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.207011] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.207103] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.207163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.207300] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.207435] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.207645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.207715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.207856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.207933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.208095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.208189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.209480] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01cd1192-3777-4f83-98f1-cca32f6277c0 [ 2463.209672] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.209779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.209847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.209997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.210079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.212323] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.213682] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.213794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.213864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.214138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.214265] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.214420] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.214520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.214582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.214724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.214864] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.214958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.215021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.215159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.215237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.215409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.215462] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.215550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.215609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.215743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.215815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.215951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.216055] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.216115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.216253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.216387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.216478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.216540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.216672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.216745] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.216825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.216903] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.222821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18eb7d56-dc9c-4516-b37c-4f4d855b4682: rpc.has_security_group_logging(os_id): False [ 2463.230683] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.230829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.230887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.231073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.231159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.231347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.231451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.231517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.231664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.231805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.231896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.231956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.232114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.232190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.232271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.232359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.234318] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5dc1b16-b068-4af0-8edb-6a8c098bd113: rpc.has_security_group_logging(os_id): False [ 2463.241806] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 2463.250136] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.250358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.250358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.250551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.255197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.255312] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.259226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.259618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.259724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.260066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.260168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.260350] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.260507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.260766] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.260948] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.261326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.261438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.261501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.261877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.262272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.262382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.262566] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.267392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2463.268485] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 317f886a-d93c-4fc5-8369-829901ec71b7 [ 2463.268674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.268794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.268863] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.269052] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.269138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.270270] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 838ac9b9-c73d-45ee-8871-c6d7b8673918 [ 2463.270452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.270563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.270632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.270795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.270876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.272288] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04c13508-87af-41b6-87ad-6357e426c059 [ 2463.272497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.272641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.272718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.272890] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.272975] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.274322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 317fd6c1-05df-48c2-ae75-1966e439fae0 [ 2463.274498] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.274610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.274677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.275338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.275434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.276966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.277088] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.277157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.277331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.277414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.277578] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.277678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.277741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.277885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.278086] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.278618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.278689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.278853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.278907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.278997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.279145] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.279236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.279293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.279434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.279514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.279646] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.279740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.279812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.279922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.280079] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.280170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.280232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.280367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.280447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.280527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.280617] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.288196] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.288375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.289264] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.289407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.289505] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.289758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.289989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.290206] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8b1b41a-f3ad-45b6-aa1c-a88b2ec09378" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.291264] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.291408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.295001] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.295183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.295296] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.295561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.295665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.295823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01cd1192-3777-4f83-98f1-cca32f6277c0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.298154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.298422] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.298542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.298609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.298780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.298875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.299075] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.299163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.299222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.299373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.299447] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.299628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.299714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.299777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.299899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.299977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.300080] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be updated. [ 2463.302808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.302976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.303066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.303256] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.303355] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.303423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.303553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.303627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.303716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dccfe94-a28c-458f-a44d-bf0826c447a8 is going to be deleted. [ 2463.304568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.304750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.305772] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.305895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.305976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.306142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.306242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.306371] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.306458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.306706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.306802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.307058] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.307155] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.307217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.307351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.307478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.307573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.307658] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.307740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.307798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.307930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.307994] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.308156] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.308249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.308335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.308435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.308567] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.308647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.308706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.308830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.308905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.308985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.309073] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.310943] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.311057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.311118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.311264] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.311342] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.311492] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.311579] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.311644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.311841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.311901] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.311997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.312091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.312257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.312340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.312542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.312542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.313341] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 334df093-4d11-4058-a3c7-b9eeaaefc7ab: rpc.has_security_group_logging(os_id): False [ 2463.331214] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.331876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.331953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.332200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.332290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.332484] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.332624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.332822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.332822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.332946] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.333032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.333091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.333200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.333278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.333362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.333524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.333639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.333703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.333804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.333877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.334021] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.334115] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.334177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.334308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.334451] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.334539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.334600] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.334730] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.334807] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.334887] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.334973] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2463.335849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2463.344090] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b00e074-bde8-46f5-8508-b86480532290: rpc.has_security_group_logging(os_id): False [ 2463.391962] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.392188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.394040] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.394165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.394826] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.394923] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.415509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.415636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.422705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.422878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.424330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.424619] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.424729] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.424788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.424996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.425078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.425167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be updated. [ 2463.426202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.426388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.427947] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.428079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.465474] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.465642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.465714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.465894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.466037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.466188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-317f886a-d93c-4fc5-8369-829901ec71b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.481911] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.482112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.482170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.482399] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.482507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.482633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dccfe94-a28c-458f-a44d-bf0826c447a8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.483417] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.483551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.483593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.483746] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.483828] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.483977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-317fd6c1-05df-48c2-ae75-1966e439fae0" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.486451] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.486568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.486610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.487126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.487126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.487126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-838ac9b9-c73d-45ee-8871-c6d7b8673918" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.492641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.492970] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.493063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.493063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.493237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.493317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.493516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.493613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.493679] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.493823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.493899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.494235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.494368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.494450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.494601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.494680] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.494773] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 2463.495860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.496034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.497817] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.497915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.501425] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.501539] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.501607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.501773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.501859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.501986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04c13508-87af-41b6-87ad-6357e426c059" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.520211] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2463.520831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.521233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.521386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.521466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.521665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.521748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.521964] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.522062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.522124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.522267] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.522344] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.522545] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.522626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.522688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.522825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.522901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.522993] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2463.524170] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.524358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.556276] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.556466] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518a0bec-8c5a-406d-bdb3-ca7657d7078f is going to be deleted. [ 2463.557424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.557627] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.588032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.588223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.633550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.633718] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be deleted. [ 2463.634755] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.634985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.695923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.696140] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.698999] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.699157] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.701126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.701292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.703079] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2463.703615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.703930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.704080] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.704168] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.704380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.704465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.704668] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.704768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.704830] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.704971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.705044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.705229] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.705315] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.705376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.705511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.705618] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.705670] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2463.706876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.707031] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.754529] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.754914] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.755102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.755219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.755510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.755647] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.755951] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.756118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.756225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.756474] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.756598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.756919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.757058] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.757167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.757404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.757538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.757699] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab is going to be updated. [ 2463.759182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.759373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.778672] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.778897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.799728] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.800042] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.800167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.800234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.800437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.800518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.800888] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.801009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.801079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.801243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.801324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.801525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.801608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.801668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.801844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.801882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.801974] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2463.803283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.803443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.803696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.804810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.805023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.805165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.806731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.806896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.806985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.807102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518a0bec-8c5a-406d-bdb3-ca7657d7078f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.807235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.807378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.807502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.808854] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.809034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.809182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.810440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.810607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.810721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.810840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.864253] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: IN_PROGRESS for 2s [ 2463.865146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: IN_PROGRESS for 2s [ 2463.867303] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 2463.871257] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2463.893949] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.894122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.894165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.894383] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.894541] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.945294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2463.947669] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.947806] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.947850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.948057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.948205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2463.962395] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2463.962582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2463.962582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2463.962826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2463.963000] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2464.004637] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: IN_PROGRESS for 2s [ 2464.006636] neutron-nsxv3-agent[62156]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2464.007002] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2465.881493] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: SUCCESS [ 2465.881877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2465.882420] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 2465.882599] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2465.883222] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: SUCCESS [ 2465.883394] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2465.884016] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2465.884190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2465.961767] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2465.961999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2466.017957] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: SUCCESS [ 2466.018177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2466.019050] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2466.019233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2468.102575] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2468.102967] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2473.104208] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2473.104708] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2478.105506] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2478.105928] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2483.106524] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2483.106880] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2488.107965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2488.107965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2488.885435] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-382ba2a1-3993-42ed-b8c3-0eb94e3334e4 req-496cb0af-eb58-4933-a01c-76e0a1a6c147 tempest-AttachInterfacesTestJSON-656904357 tempest-AttachInterfacesTestJSON-656904357-project-member] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 2488.886013] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGHEST for action security_group_members [ 2488.886387] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.886515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.886580] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.886780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.886860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2488.887014] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.887101] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.887163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.887301] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.887439] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.887528] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.887589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.887715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.887805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2488.887935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2488.898519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.898816] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.898956] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.899338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.902835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2488.902835] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be updated. [ 2488.937606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2488.937793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2488.937869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2488.938075] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2488.938223] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2488.951025] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: IN_PROGRESS for 2s [ 2490.962451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: IN_PROGRESS for 4s [ 2492.974708] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 in Status: SUCCESS [ 2492.975122] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 deletion is rescheduled due to dependency. [ 2492.975122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2493.887462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2493.887654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2498.888618] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2498.888864] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2503.889650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2503.889951] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2508.891935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2508.891935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2513.892848] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2513.892848] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2518.893498] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2518.893857] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2523.894151] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2523.894616] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2528.894887] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2528.895240] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2533.896096] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2533.896392] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2537.000345] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-7cd657a8-63d9-4346-ba6f-35d4b1e46950 req-c3adaaab-5e93-43a6-9d36-c5cbc8259753 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2537.000345] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2537.000345] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2537.009262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2537.019483] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2537.030162] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2537.030307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2537.030382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2537.030598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2537.030720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2537.030836] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2537.064601] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2537.064740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2537.064780] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2537.065124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2537.065124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2537.076136] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2539.087843] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2539.088213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2541.999821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2541.999821] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2547.001164] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2547.001506] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2552.002781] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2552.003191] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2557.003849] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2557.004228] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2562.005361] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2562.005712] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2567.006065] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2567.006340] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2572.007841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2572.007841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2577.009279] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2577.009563] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2582.010273] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2582.010521] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2583.063257] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-cbe0e156-7571-4f7d-826e-4cda02e5d735 req-c7cbf784-fa6d-49a4-a1a9-60de9d2487c1 tempest-ImagesOneServerNegativeTestJSON-1483459504 tempest-ImagesOneServerNegativeTestJSON-1483459504-project-member] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2583.063257] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGHEST for action security_group_members [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2583.063257] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.064097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.064404] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2583.064404] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.074986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2583.074986] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be updated. [ 2583.103937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2583.103937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2583.104154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2583.104196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2583.104330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2583.113491] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: IN_PROGRESS for 2s [ 2585.124726] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 in Status: SUCCESS [ 2585.125073] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 deletion is rescheduled due to dependency. [ 2585.125073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.064331] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2588.064331] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2588.242932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2d025639-9cf0-41ec-a54e-1b23ba385241 None None] Enqueued Resource ID: f78d147e-b946-4ef0-b1df-3d6a9e6ef878 with Priority: HIGHEST for action port [ 2588.242932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78d147e-b946-4ef0-b1df-3d6a9e6ef878 with Priority: HIGHEST for action port [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-f78d147e-b946-4ef0-b1df-3d6a9e6ef878 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f78d147e-b946-4ef0-b1df-3d6a9e6ef878" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f78d147e-b946-4ef0-b1df-3d6a9e6ef878" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f78d147e-b946-4ef0-b1df-3d6a9e6ef878" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.242932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f78d147e-b946-4ef0-b1df-3d6a9e6ef878',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2588.263518] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f78d147e-b946-4ef0-b1df-3d6a9e6ef878 [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.263518] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f78d147e-b946-4ef0-b1df-3d6a9e6ef878 already deleted. [ 2588.263518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f78d147e-b946-4ef0-b1df-3d6a9e6ef878" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.823750] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-2373e67a-4e76-49d2-b733-3ef0ebf5b504 tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2588.824294] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2588.824615] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.824740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.824808] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.824998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.825081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.825232] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.825334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.825387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.825568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.825649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2588.862061] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.862248] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.862297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.862472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.862565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.862660] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f already deleted. [ 2588.862744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.911114] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-944d7c01-e4ac-4a35-b87b-1e49ec25e17d tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2588.911681] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2588.911996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.912151] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.912218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.912397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.912492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.912628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.912733] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.912792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.912911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.912996] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2588.943728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2588.943879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2588.943953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2588.944179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2588.944268] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2588.944366] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f already deleted. [ 2588.944450] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.248907] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-07f30aac-ce23-4e5d-9ea7-d7ec100d39ba None None] Enqueued Resource ID: 59907fcc-f982-45c6-8aa4-6133af324f8f with Priority: HIGHEST for action port [ 2590.249465] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59907fcc-f982-45c6-8aa4-6133af324f8f with Priority: HIGHEST for action port [ 2590.249761] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.249872] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.249941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.250141] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.250225] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.250376] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-59907fcc-f982-45c6-8aa4-6133af324f8f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.250466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59907fcc-f982-45c6-8aa4-6133af324f8f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.250537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59907fcc-f982-45c6-8aa4-6133af324f8f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.250737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59907fcc-f982-45c6-8aa4-6133af324f8f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.250835] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59907fcc-f982-45c6-8aa4-6133af324f8f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2590.273739] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59907fcc-f982-45c6-8aa4-6133af324f8f [ 2590.273972] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.274152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.274252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.274433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.274523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.274617] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59907fcc-f982-45c6-8aa4-6133af324f8f already deleted. [ 2590.274736] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59907fcc-f982-45c6-8aa4-6133af324f8f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.650463] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22021719-a082-4ef1-9214-224cacb5203a req-ba97e5ed-cbe1-4be7-a075-821000afb4e5 tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2590.651102] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2590.651426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.651543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.651606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.651799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.651875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.652040] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.652137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.652186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.652373] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.652512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.652598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.652655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.652789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.652861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.652945] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2590.663555] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.663688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.663744] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.663929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.664020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.664204] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2590.664290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2590.664351] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2590.664489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2590.664559] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2590.664640] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f already deleted. [ 2590.664711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.270960] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.271298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.271298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.271527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.271635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.271932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-580 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.272117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.272242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.272508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.272758] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.272919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.273043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.273359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.273512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.273666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.274199] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.274429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.274567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.274795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.275049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.275336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-0494459b-542c-41d5-a4a6-98e75b273bea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.275532] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.275645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.275912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.276091] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0494459b-542c-41d5-a4a6-98e75b273bea',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.292469] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.292740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.292907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.293190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.293361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.293522] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 0494459b-542c-41d5-a4a6-98e75b273bea not found, creating... [ 2591.293791] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.293955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.294077] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.294320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.294468] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.294770] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.294986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.295139] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.295361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.295549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.295703] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 0494459b-542c-41d5-a4a6-98e75b273bea is going to be created. [ 2591.320124] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.320507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.320738] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.321129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.321479] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.321811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.551134] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22021719-a082-4ef1-9214-224cacb5203a req-b55536c5-0c0b-4176-8953-9f3e27c00412 service neutron] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2591.551324] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22021719-a082-4ef1-9214-224cacb5203a req-b55536c5-0c0b-4176-8953-9f3e27c00412 service neutron] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2591.551477] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22021719-a082-4ef1-9214-224cacb5203a req-b55536c5-0c0b-4176-8953-9f3e27c00412 service neutron] Enqueued Resource ID: 0494459b-542c-41d5-a4a6-98e75b273bea with Priority: HIGHEST for action port [ 2591.551705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_rules [ 2591.551830] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2591.551920] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0494459b-542c-41d5-a4a6-98e75b273bea with Priority: HIGHEST for action port [ 2591.552516] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.552639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.552699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.552902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.552979] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.553130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.553220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.553277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.553413] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.553486] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.555294] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.555396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.555465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.555719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.555815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.555961] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.556063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.556122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.556262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.556549] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.556663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.556792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.556952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.557032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.557123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.558234] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.558437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.558566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.558737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.558819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.558974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0494459b-542c-41d5-a4a6-98e75b273bea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.559073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.559134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.559304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.559358] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0494459b-542c-41d5-a4a6-98e75b273bea',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.574140] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.585235] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.585370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.585472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.585629] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.585710] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.585858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.585949] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.587845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2591.594235] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0494459b-542c-41d5-a4a6-98e75b273bea with status ACTIVE [ 2591.594438] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.594550] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.594611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.594815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.594895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.595084] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.595188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.595246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.595393] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.595466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.597514] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.597635] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.597689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.597849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.597931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.598020] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f is going to be created. [ 2591.646508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2591.646508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2591.646508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2591.646802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2591.646802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2591.656332] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: UNINITIALIZED for 2s [ 2592.054669] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2592.054915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2592.054971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2592.055211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2592.055307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2592.055421] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0494459b-542c-41d5-a4a6-98e75b273bea is going to be updated. [ 2592.085781] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2592.085934] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2592.086007] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2592.086231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2592.086375] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2592.086535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0494459b-542c-41d5-a4a6-98e75b273bea" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.666404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: SUCCESS [ 2593.666820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.666820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2593.666970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2593.667159] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2593.667266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2593.667331] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2593.667473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2593.667585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.667686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.667782] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2593.676556] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2593.682343] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f: rpc.has_security_group_logging(os_id): False [ 2593.700286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2593.700597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2593.700597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2593.701138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2593.701138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.701138] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2593.701138] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2593.701438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2593.701438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2593.701438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.701438] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f is going to be created. [ 2593.766643] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2593.766831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2593.766905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2593.767107] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2593.767385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2593.778781] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: IN_PROGRESS for 2s [ 2595.801853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: SUCCESS [ 2595.802234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2596.552797] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2596.552918] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2601.553893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2601.554407] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2606.555457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2606.555790] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2611.556643] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2611.556945] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2616.557483] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2616.557774] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2621.558462] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2621.558841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2626.559621] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2626.560084] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2631.560823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2631.561167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2632.600700] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-2b976214-04e8-42af-96fa-96768551d224 req-4962c8f8-0d3c-4478-8b8e-494cf1bc3540 tempest-ServerDiskConfigTestJSON-626819497 tempest-ServerDiskConfigTestJSON-626819497-project-member] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2632.601198] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGHEST for action security_group_members [ 2632.601525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.601626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.601691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.601881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.601958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2632.602148] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.602212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.602257] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.602390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.602524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.602608] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.602664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.602791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.602864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2632.602955] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2632.611929] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.612070] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.612136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.612317] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.612398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2632.612579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.612672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.612731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.612868] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.612938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2632.613020] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be updated. [ 2632.644451] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2632.644451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2632.644451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2632.644747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2632.644747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2632.656965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: IN_PROGRESS for 2s [ 2634.667893] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b00e074-bde8-46f5-8508-b86480532290 in Status: SUCCESS [ 2634.668195] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b00e074-bde8-46f5-8508-b86480532290 deletion is rescheduled due to dependency. [ 2634.668235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2637.602137] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2637.602486] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2642.603544] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2642.603894] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2647.604779] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2647.605077] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2652.605801] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2652.606167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2657.607481] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2657.607842] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2662.608434] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2662.608887] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2667.609492] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2667.609940] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2669.830251] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:8 completed [ 2669.830251] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:9 started [ 2672.610404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2672.610803] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2677.611213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2677.611632] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2681.816581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-15772db2-d8b0-4b2a-901c-1ca94b09996f req-ba1b09b1-43f1-49f9-a95a-b69e396e6d2c tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2681.816581] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.816581] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2681.827142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.827334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.827334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.827486] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.828032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.828032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.828032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.828032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.828032] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.828456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.828456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2681.862314] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.862515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.862598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.862860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.863381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.881374] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2683.582126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-acd6d392-b889-4c50-b421-2fa8ba3e3d55 req-d7d95397-fea9-4042-aba8-84d098b35966 tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2683.582126] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.582126] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.892366] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2683.892543] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 deletion is rescheduled due to dependency. [ 2683.892675] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.892832] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.893043] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.893224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.893352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.893397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.893543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.893624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.893716] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2683.896857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.897192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.897192] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.897369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.897506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.897751] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-733 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.897901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.898025] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.898229] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.898519] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.898684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.898800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.899001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.899135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.899277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-733" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.899554] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.899779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.899954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.900490] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.900703] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.901574] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-7bb4d2cc-6c15-46f2-9750-703926d3a104 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.901767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.901891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.902152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.902720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bb4d2cc-6c15-46f2-9750-703926d3a104',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2683.908670] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.908785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.909063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.909242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.909327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.909512] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.909603] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.909664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.909802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.909875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.909959] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2683.932856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.933060] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.933186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.933464] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.933612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.933763] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 7bb4d2cc-6c15-46f2-9750-703926d3a104 not found, creating... [ 2683.934022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.934176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.934293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.934520] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.934655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.934932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.935212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.935333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.935536] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.935669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.935808] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 7bb4d2cc-6c15-46f2-9750-703926d3a104 is going to be created. [ 2683.938737] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.938847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.938906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.939057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.939184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.101751] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.102026] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.102159] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.102431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.102671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.102891] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.104248] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2684.317827] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-acd6d392-b889-4c50-b421-2fa8ba3e3d55 req-cc9931c4-6878-416a-9e6a-ed1e15dccd3d service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 2684.318006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-acd6d392-b889-4c50-b421-2fa8ba3e3d55 req-cc9931c4-6878-416a-9e6a-ed1e15dccd3d service neutron] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2684.318173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-acd6d392-b889-4c50-b421-2fa8ba3e3d55 req-cc9931c4-6878-416a-9e6a-ed1e15dccd3d service neutron] Enqueued Resource ID: 7bb4d2cc-6c15-46f2-9750-703926d3a104 with Priority: HIGHEST for action port [ 2684.318426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_rules [ 2684.318562] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2684.318726] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb4d2cc-6c15-46f2-9750-703926d3a104 with Priority: HIGHEST for action port [ 2684.319508] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.319637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.319707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.319921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.320017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.320174] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.320271] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.320332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.320495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.320583] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2684.321463] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.321463] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.321569] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.321674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.321761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.321895] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.321954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.322130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.322222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.322284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.322422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.322500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.324433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bb4d2cc-6c15-46f2-9750-703926d3a104 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.324433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.324433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.324433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.324433] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bb4d2cc-6c15-46f2-9750-703926d3a104',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2684.344504] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.344900] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.345050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.345337] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.346030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.346030] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.346180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.348064] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bb4d2cc-6c15-46f2-9750-703926d3a104 with status ACTIVE [ 2684.348265] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.348406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.348499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.348819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.348819] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.348967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.349033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.349083] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.349224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.349293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.679414] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.679886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.679886] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.679986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.679986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.680105] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bb4d2cc-6c15-46f2-9750-703926d3a104 is going to be updated. [ 2684.704386] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2684.704624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2684.704624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2684.704908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2684.705050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2684.705210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bb4d2cc-6c15-46f2-9750-703926d3a104" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2686.114372] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2686.114759] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 deletion is rescheduled due to dependency. [ 2686.114759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2686.114846] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2686.115020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2686.115205] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2686.115322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2686.115387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2686.115672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2686.115672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2686.115841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2686.125047] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2686.134469] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2686.141405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2686.141561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2686.141609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2686.141813] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2686.141901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2686.141998] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2686.169904] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2686.170082] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2686.170154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2686.170369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2686.170513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2686.178691] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2688.188677] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2688.189048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.189048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.189234] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.189436] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.189575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.189644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.189836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.189896] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.189957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.190045] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2688.198777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.198945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.198945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.199105] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.199184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.199339] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.199428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.199506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.199657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.199798] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.199937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.199997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.200100] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.200176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.200256] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.200405] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.200497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.200556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.200691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.200761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.200897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.200986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.201044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.201176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.201310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.201396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.201457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.201589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.201663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.201743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.201828] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2688.207645] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2688.225571] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.225778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.225778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.225954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.226045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.226243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.226345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.226429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.226590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.226671] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.226868] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.226965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.227028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.227166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.227242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.227441] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.227538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.227601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.227768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.227847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.227933] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2688.291609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2688.291831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2688.291831] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2688.291964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2688.292150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2688.303446] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2689.319764] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2689.320166] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2690.317447] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2690.317634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2694.320840] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2694.321152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2699.322732] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2699.322732] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2701.706825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2701.707311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2701.707311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2701.707311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2701.707558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2701.707558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2701.707696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2701.707696] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2701.707820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2701.707890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2701.716232] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2701.722696] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2701.728768] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2701.728885] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2702.332543] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.332869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.332869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.333029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.345921] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2702.346345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.347130] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2702.382875] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.383207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.383207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.383365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.395245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.396140] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:2. [ 2702.396233] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'15820fe8-1aac-42ed-a79f-b4b2c414cfd5', '9d167977-64b1-4a6e-a1db-997d13b4fd6f'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2702.396309] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2702.420220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.420521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.420521] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.420673] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.421065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.421196] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2702.458674] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.458955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.458955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.459106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.459305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.459493] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2702.496209] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.496526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.496526] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.496683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.496782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.496960] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 2702.497039] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b5dc1b16-b068-4af0-8edb-6a8c098bd113', '380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f', '8b00e074-bde8-46f5-8508-b86480532290', '7ea8d7be-8b11-4b87-8a05-b58b1f021038', '334df093-4d11-4058-a3c7-b9eeaaefc7ab', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d', '18eb7d56-dc9c-4516-b37c-4f4d855b4682', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2702.497167] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2702.514175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.514434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.514434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.514605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.514669] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.514748] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2702.514811] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2702.514875] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2702.554166] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.554475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.554475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.554633] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.554970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.555127] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2702.555202] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2702.555270] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2702.555335] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 2/2 resources of Type:Ports [ 2702.555399] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15820fe8-1aac-42ed-a79f-b4b2c414cfd5 with Priority: HIGH for action port [ 2702.555472] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d167977-64b1-4a6e-a1db-997d13b4fd6f with Priority: HIGH for action port [ 2702.555555] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 2702.555634] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2702.555705] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGH for action security_group_rules [ 2702.555772] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2702.555772] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2702.555891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2702.555891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2702.556028] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2702.556028] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2702.556148] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2702.556148] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2702.556301] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.556436] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.556507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.556598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.556677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.556843] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.556925] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.556993] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.557113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.557182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.557383] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.557467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.557527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.557652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.557721] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.557882] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.557969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.558037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.558145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.558216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.558368] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.558489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.558555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.558632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.558695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.558857] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.558940] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.559001] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.559119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.559233] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.559347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.559467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.559535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.559601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.559661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.559825] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.559909] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.559970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.560109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.560186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.560333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.560497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.560497] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.560631] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.560692] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.560807] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.560897] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.560958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.561066] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.561134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.561286] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.561370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.561430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.561544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.561607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.561765] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.561845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.561906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.562019] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.562085] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.562239] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.562327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.562388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.562499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.562566] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.562721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.562811] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.562874] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.562978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.563040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.563197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.563278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.563338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.563453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.563523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.563680] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.563771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.563833] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.563938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.563999] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.564173] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.564254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.564322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.564433] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.564495] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.564656] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.564737] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.564798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.564911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.564980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.565134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.565222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.565283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.565391] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.565458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.565675] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.565764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.565825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.565943] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.566005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.566164] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.566244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.566304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.566425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.566506] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.566649] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.566735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.566796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.566907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.566969] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.567126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.567213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.567290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.567382] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.567446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.567603] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.567689] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.567750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.567865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.567933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.568035] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2702.568119] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2702.568186] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2702.609984] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.610297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.610297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.610439] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.610558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.610722] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2702.647210] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2702.647540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2702.647540] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2702.647699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2702.647773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2702.664965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 2702.665169] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.323871] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2704.324159] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=11], Jobs=0 [ 2704.324159] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15820fe8-1aac-42ed-a79f-b4b2c414cfd5 with Priority: HIGH for action port [ 2704.324272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_rules [ 2704.324351] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2704.324451] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 2704.324548] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2704.324642] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 with Priority: HIGH for action security_group_rules [ 2704.324733] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2704.324824] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2704.324914] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b00e074-bde8-46f5-8508-b86480532290 with Priority: HIGH for action security_group_rules [ 2704.325004] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d167977-64b1-4a6e-a1db-997d13b4fd6f with Priority: HIGH for action port [ 2704.325093] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGH for action security_group_rules [ 2704.325447] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.325584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.325674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.325859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.325942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.326096] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-15820fe8-1aac-42ed-a79f-b4b2c414cfd5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.326187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15820fe8-1aac-42ed-a79f-b4b2c414cfd5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.326251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15820fe8-1aac-42ed-a79f-b4b2c414cfd5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.326459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15820fe8-1aac-42ed-a79f-b4b2c414cfd5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.326551] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15820fe8-1aac-42ed-a79f-b4b2c414cfd5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.327502] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.327613] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.327677] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.327829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.327907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.328070] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.328165] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.328235] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.328367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.328457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.329251] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.329790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.329858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.330012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.330090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.330333] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.330333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.330421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.330499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.330561] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.332814] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.332928] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.332995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.333145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.333222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.333359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.333452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.333518] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.333649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.333890] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.334616] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.334726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.334790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.334937] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.335013] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.335150] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.335236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.335298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.335429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.335496] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18eb7d56-dc9c-4516-b37c-4f4d855b4682',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.336187] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.336297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.336361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.336535] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.336616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.336759] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.336850] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.336911] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.337048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.337116] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.337788] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.337898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.337964] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.338111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.338186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.338326] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.338446] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.338502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.338639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.338705] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.339497] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.339619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.339688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.339838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.339941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.340058] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b00e074-bde8-46f5-8508-b86480532290 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.340152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.340213] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.340348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.340419] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b00e074-bde8-46f5-8508-b86480532290',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.341088] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.341197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.341262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.341406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.341484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.341623] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d167977-64b1-4a6e-a1db-997d13b4fd6f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.341711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d167977-64b1-4a6e-a1db-997d13b4fd6f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.341771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d167977-64b1-4a6e-a1db-997d13b4fd6f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.341951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d167977-64b1-4a6e-a1db-997d13b4fd6f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.342022] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d167977-64b1-4a6e-a1db-997d13b4fd6f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.342692] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.342799] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.342865] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.343034] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.343158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.343320] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.343416] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.343481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.343622] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.343690] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.345644] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15820fe8-1aac-42ed-a79f-b4b2c414cfd5 [ 2704.345816] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.345918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.345986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.346136] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.346218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.382794] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.383009] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.383112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.383347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.385237] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d167977-64b1-4a6e-a1db-997d13b4fd6f [ 2704.385469] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.385624] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.385720] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.386086] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.386217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.392900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.393073] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.393172] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.393388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.393507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.393695] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.393825] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.393913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.394094] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.394276] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.394398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.394485] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.394654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.394767] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.394876] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.394985] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.395954] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.396118] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.396220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.396435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.396562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.396746] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.396875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.396963] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.397133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.397310] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.397434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.397522] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.397688] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.397796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.397903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.398013] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.401015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.401175] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.401269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.401459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.401575] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.401760] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.402012] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.402112] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.402287] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.402471] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.402623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.402913] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.403132] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.403269] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.403374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.403468] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.404365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.404477] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.404544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.404697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.404773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.404917] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.405011] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.405079] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.405228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.405373] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.405582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.405582] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.405698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.405777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.405859] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.405968] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.407747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.407853] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18eb7d56-dc9c-4516-b37c-4f4d855b4682 is going to be deleted. [ 2704.411841] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.412014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.412014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.412186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.412294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.412513] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.412666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.412763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.413121] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.413354] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.413500] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.413587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.413741] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.413840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.413971] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.414158] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.414259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.414334] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.414461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.414558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.414736] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.414838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.414898] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.415036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.415175] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.415266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.415326] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.415456] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.415534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.415636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.415730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.422023] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.422173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.422272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.422549] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.422687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.422865] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.423016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.423262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.423453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.423685] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.423842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.423950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.424178] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.424295] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.424415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.424635] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.424764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.424852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.425040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.425148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.425338] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.425467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.425561] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.425750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.425944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.426072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.426163] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.426354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.426466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.426584] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.426707] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.429369] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.429514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.429607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.429814] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.429922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.430126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.430260] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.430352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.430577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.430803] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.430952] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.431051] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.431273] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.431397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.431527] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.431750] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.431883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.431976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.432210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.432320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.432533] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.432672] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.432773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.432982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.433323] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.433488] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.433590] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.433812] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.433945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.434078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.434212] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.435302] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.435453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.435562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.435789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.435921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.436255] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.436484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.436583] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.436750] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.436904] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.437005] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.437065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.437207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.437286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.437370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.437524] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.437616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.437674] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.437810] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.437880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.438018] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.438099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.438158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.438290] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.438480] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.438576] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.438636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.438765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.438840] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.438921] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.439007] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.442932] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.443044] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.443109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.443237] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.444357] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 334df093-4d11-4058-a3c7-b9eeaaefc7ab: rpc.has_security_group_logging(os_id): False [ 2704.445213] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ef40af-7afd-4ed0-88b3-071f1aba7488: rpc.has_security_group_logging(os_id): False [ 2704.448062] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.448187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.448255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.448428] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.448508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.448666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.448758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.448826] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.448953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.449095] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.449188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.449254] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.449461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.449552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.449634] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.449719] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.450784] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea8d7be-8b11-4b87-8a05-b58b1f021038: rpc.has_security_group_logging(os_id): False [ 2704.454056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2704.457317] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.457434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.460388] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2704.467146] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f: rpc.has_security_group_logging(os_id): False [ 2704.483039] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.483340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.484243] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.484340] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.485353] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.485449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.486152] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.486245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.486977] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.487068] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.489785] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.489926] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b00e074-bde8-46f5-8508-b86480532290 is going to be deleted. [ 2704.490787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.491024] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.492437] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.492544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.496569] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.496717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.496792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.496938] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.497028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.497156] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15820fe8-1aac-42ed-a79f-b4b2c414cfd5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.497821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.497936] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.497997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.498134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.498216] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.498341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d167977-64b1-4a6e-a1db-997d13b4fd6f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.548022] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.548266] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 is going to be deleted. [ 2704.549201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.549425] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.577358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.577596] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.577714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.577778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.577987] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.578071] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.578308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.578452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.578615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.578684] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.578747] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.578937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.579035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.579097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.579208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.579286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.579412] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab is going to be updated. [ 2704.580652] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.580839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.630566] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.630852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.633606] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.633871] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.633989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.634072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.634255] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.634341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.634542] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.634654] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.634715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.634844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.634920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.635111] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.635195] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.635258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.635377] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.635443] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.635534] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2704.636844] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.637017] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.667406] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.667687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.683801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.684192] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.684293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.684378] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.684562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.684649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.684745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f is going to be updated. [ 2704.685867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.686039] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.686124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.686243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18eb7d56-dc9c-4516-b37c-4f4d855b4682" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.686427] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.686693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.719997] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.720311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.721149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.721369] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.721481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.721542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.721740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.721823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.722016] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.722144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.722208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.722307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.722386] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.722583] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.722658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.722716] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.722853] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.722932] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.723023] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2704.724128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.724293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.725845] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.725954] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.769262] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.769730] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.769945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.770062] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.770370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.770519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.770881] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.771053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.771167] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.771459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.771610] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.771998] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.772161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.772277] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.772512] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.772649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.772804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 is going to be updated. [ 2704.774552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.774792] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.774935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.775124] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b00e074-bde8-46f5-8508-b86480532290" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.775330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.775568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.775797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.777408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.777668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.777950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.778153] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.778359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.778607] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.778837] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.813922] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.814207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.814207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.814335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.814483] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.833088] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2704.833842] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: IN_PROGRESS for 2s [ 2704.834550] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: IN_PROGRESS for 2s [ 2704.882550] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.882788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.882788] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.882986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.883152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.914891] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2704.931521] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2704.931794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2704.931794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2704.931944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2704.932122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2704.959965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: IN_PROGRESS for 2s [ 2706.848809] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2706.849244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2706.849696] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: SUCCESS [ 2706.849873] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2706.850488] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: SUCCESS [ 2706.850664] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2706.929863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2706.930106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2706.972214] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 in Status: SUCCESS [ 2706.972470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2709.325983] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2709.326212] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2714.327584] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2714.328021] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2719.328756] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2719.329134] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2724.330251] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2724.330560] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2729.331746] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2729.332144] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2731.836457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-81a1e20d-e1d2-435e-acc6-26bd251b334f req-c51a2d2a-c2bf-42f8-83b3-2753408737d0 tempest-ServersNegativeTestMultiTenantJSON-343759983 tempest-ServersNegativeTestMultiTenantJSON-343759983-project-member] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2731.836457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGHEST for action security_group_members [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2731.836457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2731.845220] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.845309] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.845453] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.845551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.845587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2731.845777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.845894] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.845941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.846137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.846137] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2731.846215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab is going to be updated. [ 2731.875438] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2731.875586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2731.875662] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2731.875857] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2731.876008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2731.886054] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: IN_PROGRESS for 2s [ 2733.897649] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab in Status: SUCCESS [ 2733.897913] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab deletion is rescheduled due to dependency. [ 2733.897966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2736.835296] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2736.835694] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2741.836599] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2741.837055] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2746.837338] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2746.837745] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2751.838922] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2751.839276] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2756.839841] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2756.840217] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2761.841475] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2761.841928] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2766.842965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2766.842965] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2771.844368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2771.844704] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2776.845850] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2776.846277] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2781.846717] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2781.847056] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2781.905508] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-14b03297-e0a3-4eb9-a54e-dfade91c4393 req-22991046-1afa-4807-b990-5e1b2506c605 tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2781.906039] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2781.906365] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.906593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.906593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.907514] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.907967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.907967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.907967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2781.907967] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2781.916472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.916612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.916665] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.916815] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.916893] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2781.917060] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.917147] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.917224] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.917338] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.917407] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2781.917488] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2781.951308] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2781.951515] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2781.951570] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2781.951858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2781.952054] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2781.973196] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2783.984370] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2783.984765] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d deletion is rescheduled due to dependency. [ 2783.984765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.849129] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-604118ba-21a9-4a9b-9bda-6c184136cfde req-104077ee-8f52-4611-9304-f3bc684e9cdc tempest-DeleteServersTestJSON-2066579215 tempest-DeleteServersTestJSON-2066579215-project-member] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2784.849129] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2784.849129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.849129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.849129] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.849858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.849858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.849858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.849858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.849858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.850228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.850228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.850228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.850228] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.850430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.850430] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.850503] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2784.862207] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.862360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.862438] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.862637] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.862763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.862919] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.863016] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.863087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.863212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.863283] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.863369] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2784.891797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2784.892074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2784.892074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2784.892297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2784.892380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2784.901783] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2785.184426] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.184793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.184793] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.185053] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.185208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.185475] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-445 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.185666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.185768] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.185991] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.186245] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.186423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.186568] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.186734] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.186879] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.187029] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-445" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.187309] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.187476] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.187598] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.187805] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.187941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.188202] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.188360] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.188516] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.188802] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.188944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b93cfb0-3c63-46f8-95a9-5d7a45a02d13',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2785.210384] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.210666] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.210906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.211202] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.211361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.211520] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 not found, creating... [ 2785.211782] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.211945] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.212087] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.212311] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.212459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.212754] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.212914] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.213037] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.213246] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.213385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.213530] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 is going to be created. [ 2785.234611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.234905] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.235033] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.235329] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.235573] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.235803] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.482215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-604118ba-21a9-4a9b-9bda-6c184136cfde req-fdcd742f-b714-40a3-ae8d-17e605deb12b service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2785.482404] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-604118ba-21a9-4a9b-9bda-6c184136cfde req-fdcd742f-b714-40a3-ae8d-17e605deb12b service neutron] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2785.482573] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-604118ba-21a9-4a9b-9bda-6c184136cfde req-fdcd742f-b714-40a3-ae8d-17e605deb12b service neutron] Enqueued Resource ID: 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 with Priority: HIGHEST for action port [ 2785.482807] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_rules [ 2785.482935] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGHEST for action security_group_members [ 2785.483029] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 with Priority: HIGHEST for action port [ 2785.483565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.483693] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.483763] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.483967] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.484069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.484226] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.484323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.484385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.484537] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.484613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2785.485565] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.485682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.485749] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.485904] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.485982] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.486123] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.486204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.486464] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.486565] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.486626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.486771] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.486847] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.486986] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.487072] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.487130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.487263] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.487337] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b93cfb0-3c63-46f8-95a9-5d7a45a02d13',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2785.516163] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.516323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.516421] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.516908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.516908] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.516908] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.517095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.521205] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 with status ACTIVE [ 2785.521372] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.521481] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.521546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.521718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.521801] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.521966] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.522056] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.522117] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.522253] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.522327] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.880346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.880592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.880592] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.880683] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.880770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.880874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b93cfb0-3c63-46f8-95a9-5d7a45a02d13 is going to be updated. [ 2785.902416] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2785.902676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2785.902676] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2785.902902] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2785.903081] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2785.903278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b93cfb0-3c63-46f8-95a9-5d7a45a02d13" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2786.912673] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2786.912673] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d deletion is rescheduled due to dependency. [ 2786.913102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2786.913102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2786.913102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2786.913222] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2786.913341] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2786.913406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2786.913558] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2786.913642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2786.913738] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2786.921973] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2786.929127] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2786.935288] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2786.935424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2786.935482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2786.935663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2786.935751] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2786.935844] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2786.961974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2786.962182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2786.962182] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2786.962359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2786.962501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2786.970738] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2788.981271] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2788.981591] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.981638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.981836] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.982023] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.982133] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.982198] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.982345] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.982424] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.982504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.982594] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2788.991854] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.991985] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.992045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.992218] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.992298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.992472] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.992614] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.992686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.993184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.993184] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.993184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.993184] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.993362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.993362] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.993435] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.993587] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.993678] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.993740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.993877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.993951] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.994092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.994183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.994242] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.994376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.994509] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2788.994601] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2788.994657] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2788.994787] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2788.994861] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.994939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2788.995023] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2789.000664] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8a9270b-cd6f-4c8e-8912-9837cafaad4d: rpc.has_security_group_logging(os_id): False [ 2789.017161] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.017930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.018259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.018259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.018336] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.018406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.018484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.018632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.018711] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.018902] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.018996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.019057] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.019222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.019299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.019382] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d is going to be updated. [ 2789.076994] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.077211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.077211] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.077390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.077547] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.092083] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: IN_PROGRESS for 2s [ 2790.483888] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2790.484339] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2791.107611] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d in Status: SUCCESS [ 2791.107829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2795.484846] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2795.485172] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2800.486006] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2800.486416] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2805.487203] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2805.487586] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2810.488851] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2810.489261] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2815.489818] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2815.490215] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2820.491543] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2820.491960] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2825.493097] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2825.493426] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2828.176694] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-22021719-a082-4ef1-9214-224cacb5203a req-58a95a36-c6e1-4f07-9717-603b7583178f tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2828.177194] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGHEST for action security_group_members [ 2828.177570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.177641] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.177735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.177889] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.177988] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2828.178134] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.178243] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.178284] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.178472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.178608] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.178779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.178779] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.178966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.178966] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2828.179050] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2828.188242] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.188385] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.188442] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.188644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.188735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2828.188924] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.189008] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.189063] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.189205] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.189281] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2828.189364] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f is going to be updated. [ 2828.221811] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2828.222030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2828.222030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2828.222249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2828.222376] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2828.232456] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: IN_PROGRESS for 2s [ 2829.223813] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-c0299d21-875d-44ba-9cd0-b69d00fcdacb tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2829.224094] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2829.224630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.224757] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.224829] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.225030] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.225114] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2829.225266] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.225361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.225423] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.225681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.225681] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2829.253821] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.253970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.254021] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.254196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.254286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2829.254383] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563c2122-1b0a-4c12-a131-7064e7de625f already deleted. [ 2829.254466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2829.298348] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [None req-39487ac9-d8fd-4a95-a744-c371afb4bf0a tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2829.298877] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2829.299193] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.299314] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.299384] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.299585] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.299668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2829.299819] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.299915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.299977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.300135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.300214] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2829.327718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2829.327862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2829.327916] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2829.328134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2829.328226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2829.328322] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563c2122-1b0a-4c12-a131-7064e7de625f already deleted. [ 2829.328406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.243002] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f in Status: SUCCESS [ 2830.243321] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f deletion is rescheduled due to dependency. [ 2830.243380] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.938306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-03746be7-0351-4bf6-a2b8-d1f9be2571e9 req-386b686b-a6b4-4b38-af56-bdc8d383812f tempest-AttachVolumeShelveTestJSON-216431597 tempest-AttachVolumeShelveTestJSON-216431597-project-member] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_members [ 2830.938950] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_members [ 2830.939315] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2830.939487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2830.939487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2830.939691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2830.939776] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.939933] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2830.940036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2830.940120] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2830.940531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2830.940531] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2830.940531] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2830.940717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2830.940717] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2830.940790] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.940893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2830.950733] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2830.950947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2830.950947] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2830.951127] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2830.951173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.951359] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2830.951466] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2830.951517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2830.951659] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2830.951740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2830.951823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563c2122-1b0a-4c12-a131-7064e7de625f already deleted. [ 2830.951899] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.426672] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.427035] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.427116] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.427347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.427502] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.427777] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock network-580 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.427942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.428084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.428310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.428633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.428798] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.428918] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.429130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.429343] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.429538] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "network-580" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.429806] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.429968] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.430090] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.430410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.430556] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.430856] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock port-66b22077-7e60-4621-875e-429bd3311b9e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.431028] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.431149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.431409] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.431551] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66b22077-7e60-4621-875e-429bd3311b9e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.445805] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.445978] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.446109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.446367] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.446480] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.446635] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Segment Port 66b22077-7e60-4621-875e-429bd3311b9e not found, creating... [ 2831.446878] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.447036] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.447241] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.447369] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.447511] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.447797] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.447957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.448102] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.448313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.448475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.448623] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Resource: SegmentPort with ID: 66b22077-7e60-4621-875e-429bd3311b9e is going to be created. [ 2831.469160] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.469461] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.469551] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.469822] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.469965] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.470188] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [None req-b44fdac7-35c8-46e3-a534-4ec4d17704ea None None] Releasing lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.699278] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-03746be7-0351-4bf6-a2b8-d1f9be2571e9 req-8bcfbc94-cca1-461d-a956-e6a9c4fa9d2d service neutron] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2831.699492] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-03746be7-0351-4bf6-a2b8-d1f9be2571e9 req-8bcfbc94-cca1-461d-a956-e6a9c4fa9d2d service neutron] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_members [ 2831.699654] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-03746be7-0351-4bf6-a2b8-d1f9be2571e9 req-8bcfbc94-cca1-461d-a956-e6a9c4fa9d2d service neutron] Enqueued Resource ID: 66b22077-7e60-4621-875e-429bd3311b9e with Priority: HIGHEST for action port [ 2831.700170] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_rules [ 2831.700308] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGHEST for action security_group_members [ 2831.700405] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b22077-7e60-4621-875e-429bd3311b9e with Priority: HIGHEST for action port [ 2831.700721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.700866] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.700944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.701186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.701286] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.701466] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.701587] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.701667] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.701839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.701935] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.702773] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.702883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.702950] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.703097] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.703173] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.703318] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.703410] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.703472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.703612] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.703751] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.703842] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.703901] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.704049] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.704130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.704216] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.705142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.705210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.705249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.705419] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.705492] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.705667] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-66b22077-7e60-4621-875e-429bd3311b9e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.705774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.705855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.706020] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.706099] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66b22077-7e60-4621-875e-429bd3311b9e',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.727413] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.727605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.727653] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.727860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.727935] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.728131] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.728220] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.729858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.740718] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66b22077-7e60-4621-875e-429bd3311b9e with status ACTIVE [ 2831.741034] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.741232] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.741348] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.741649] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.741797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.742043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.742196] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.742266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.742429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.742501] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.744106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2831.752944] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.753093] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.753166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.753365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.753472] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.753570] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563c2122-1b0a-4c12-a131-7064e7de625f is going to be created. [ 2831.792849] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2831.792997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2831.793059] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2831.793272] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2831.793437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2831.803147] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563c2122-1b0a-4c12-a131-7064e7de625f in Status: UNINITIALIZED for 2s [ 2832.100195] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2832.100418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2832.100418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2832.100605] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2832.100699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2832.100832] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66b22077-7e60-4621-875e-429bd3311b9e is going to be updated. [ 2832.121858] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2832.122099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2832.122099] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2832.122278] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2832.122398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2832.122555] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66b22077-7e60-4621-875e-429bd3311b9e" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.813422] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563c2122-1b0a-4c12-a131-7064e7de625f in Status: SUCCESS [ 2833.813699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.813699] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2833.813917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2833.814118] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2833.814239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2833.814304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2833.814460] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2833.814544] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.814630] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.814720] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2833.823666] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2833.829942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 563c2122-1b0a-4c12-a131-7064e7de625f: rpc.has_security_group_logging(os_id): False [ 2833.847937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2833.848145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2833.848145] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2833.848359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2833.848459] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.848737] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2833.848835] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2833.848875] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2833.849014] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2833.849091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.849179] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563c2122-1b0a-4c12-a131-7064e7de625f is going to be created. [ 2833.906663] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2833.906663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2833.906663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2833.906663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2833.906663] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2833.918666] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563c2122-1b0a-4c12-a131-7064e7de625f in Status: IN_PROGRESS for 2s [ 2835.931021] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563c2122-1b0a-4c12-a131-7064e7de625f in Status: SUCCESS [ 2835.931411] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2836.701815] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2836.702028] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2841.702883] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2841.703272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2846.704393] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2846.704716] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2851.705476] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2851.705911] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2856.706593] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2856.706895] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2861.708108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2861.708513] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2866.709932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2866.709932] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2871.711032] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2871.711032] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2876.711962] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2876.712613] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2881.713208] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2881.713566] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2886.714568] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2886.714874] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2891.715863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2891.715863] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2896.716792] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2896.717152] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2901.718593] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2901.719034] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2906.720431] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2906.720868] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2909.830701] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:9 completed [ 2909.831013] neutron-nsxv3-agent[62156]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45c17e08-c14c-4bd4-b8f8-549a4ba18330 None None] NSXv3 Agent Agent loop - iteration:10 started [ 2911.721870] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2911.722201] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2916.723721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2916.724100] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2921.724669] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2921.725040] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2926.725990] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2926.726272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2927.708828] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [req-acd6d392-b889-4c50-b421-2fa8ba3e3d55 req-c9b423de-394c-4465-8fd6-0d4724d99a7d tempest-ServersTestJSON-1219570964 tempest-ServersTestJSON-1219570964-project-member] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2927.709368] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGHEST for action security_group_members [ 2927.709726] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.709858] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.709919] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.710134] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.710212] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2927.710364] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.710454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.710517] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.710650] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.710783] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.710862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.710915] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.711048] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.711122] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2927.711206] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2927.725197] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.725441] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.725525] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.725742] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.725917] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2927.726222] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.726508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.726508] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.726754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.726754] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2927.726877] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 is going to be updated. [ 2927.766591] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2927.766770] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2927.766845] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2927.767050] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2927.767204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2927.777088] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: IN_PROGRESS for 2s [ 2929.788317] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 in Status: SUCCESS [ 2929.788686] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 deletion is rescheduled due to dependency. [ 2929.788686] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2932.710886] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2932.711272] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2937.711906] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2937.712230] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2941.706511] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2941.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2941.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2941.706976] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2941.707166] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2941.707224] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2941.707297] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2941.707374] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2941.707507] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2941.707613] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2941.715575] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2941.722423] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2941.728454] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2941.728603] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2942.303139] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.303440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.303440] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.303597] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.314845] neutron-nsxv3-agent[62156]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2942.315305] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.316457] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2942.357775] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.358095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.358095] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.358250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.370333] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.371260] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:3. [ 2942.371346] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'14f95e8f-54f9-4404-ac87-211850857c49', '0b2332c2-5aa3-4bd1-a09a-30ca9753e285', '12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2942.371442] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2942.395665] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.395996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.395996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.396201] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.396484] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.396759] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2942.434481] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.434765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.434765] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.434922] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.435110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.435280] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2942.470189] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.470491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.470491] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.470638] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.470762] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.470930] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:6. [ 2942.471009] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7ea8d7be-8b11-4b87-8a05-b58b1f021038', '334df093-4d11-4058-a3c7-b9eeaaefc7ab', '380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f', 'f3ef40af-7afd-4ed0-88b3-071f1aba7488', '563c2122-1b0a-4c12-a131-7064e7de625f', 'd8a9270b-cd6f-4c8e-8912-9837cafaad4d'} {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2942.471128] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2942.489032] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.489823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.489823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.489823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.489823] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.489823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2942.489823] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2942.489823] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2942.536236] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.536552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.536552] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.536697] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.537110] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.537281] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2942.537355] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62156) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2942.537422] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2942.537486] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 3/3 resources of Type:Ports [ 2942.537556] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14f95e8f-54f9-4404-ac87-211850857c49 with Priority: HIGH for action port [ 2942.537627] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b2332c2-5aa3-4bd1-a09a-30ca9753e285 with Priority: HIGH for action port [ 2942.537714] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7 with Priority: HIGH for action port [ 2942.537791] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Security Group Rules [ 2942.537854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2942.537854] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2942.537991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGH for action security_group_rules [ 2942.537991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2942.538121] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGH for action security_group_rules [ 2942.538121] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2942.538243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2942.538243] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2942.538362] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.538473] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.538593] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.538726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.538797] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.538974] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.539061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.539123] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.539250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.539316] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.539506] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.539626] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.539691] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.539821] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.539883] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.540064] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.540154] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.540226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.540335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.540397] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.540570] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.540661] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.540724] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.540839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.540903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.541067] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.541161] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.541222] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.541335] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.541398] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.541558] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.541646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.541707] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.541820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.541881] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.542043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.542125] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.542186] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.542306] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.542368] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.542633] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.542731] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.542795] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.542920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.542998] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.543149] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.543252] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.543321] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.543414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.543478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.543642] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.543740] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.543804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.543903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.543974] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.544143] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.544236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.544298] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.544406] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.544467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.544630] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.544719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.544781] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.544895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.544957] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.545120] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.545208] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.545275] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.545381] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.545451] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.545606] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.545726] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.545791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.545869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.545941] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.546095] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.546226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.546226] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.546353] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.546426] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.546611] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.546695] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.546759] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.546880] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.546942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.547106] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.547187] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.547258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.547370] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.547431] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.547593] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.547681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.547743] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.547856] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.547920] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.548092] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.548177] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.548250] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.548358] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.548422] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.548607] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.548698] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.548761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.548877] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.548939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.549102] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.549190] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.549258] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.549365] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.549429] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.549619] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.549718] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.549782] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.549895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.549958] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.550062] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:16 [ 2942.550128] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 11 of least updated resources [ 2942.550194] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_members [ 2942.550275] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_members [ 2942.550340] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_members [ 2942.550400] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_members [ 2942.550460] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_members [ 2942.550520] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_members [ 2942.550588] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_members [ 2942.550650] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_members [ 2942.550721] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with Priority: HIGH for action port [ 2942.550782] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_members [ 2942.550844] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with Priority: HIGH for action port [ 2942.550907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.713551] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2942.713991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 2942.713991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f95e8f-54f9-4404-ac87-211850857c49 with Priority: HIGH for action port [ 2942.713991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7 with Priority: HIGH for action port [ 2942.713991] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef40af-7afd-4ed0-88b3-071f1aba7488 with Priority: HIGH for action security_group_rules [ 2942.714336] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 with Priority: HIGH for action security_group_members [ 2942.714336] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with Priority: HIGH for action port [ 2942.714336] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab204b-f602-43f2-b825-e60a546adb0f with Priority: HIGH for action security_group_members [ 2942.714336] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with Priority: HIGH for action port [ 2942.714580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 with Priority: HIGH for action security_group_members [ 2942.714580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_members [ 2942.714580] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 with Priority: HIGH for action security_group_members [ 2942.714804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41457c53-0beb-498e-9602-79d16e17cd73 with Priority: HIGH for action security_group_members [ 2942.714804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dc1b16-b068-4af0-8edb-6a8c098bd113 with Priority: HIGH for action security_group_members [ 2942.714804] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9006-ba9f-4366-9e90-536f58fe86a5 with Priority: HIGH for action security_group_members [ 2942.714981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf69e81-3cbd-4cd2-b99e-b75388d904b7 with Priority: HIGH for action security_group_members [ 2942.714981] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a9270b-cd6f-4c8e-8912-9837cafaad4d with Priority: HIGH for action security_group_rules [ 2942.715108] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f with Priority: HIGH for action security_group_rules [ 2942.715173] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c2122-1b0a-4c12-a131-7064e7de625f with Priority: HIGH for action security_group_rules [ 2942.715234] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334df093-4d11-4058-a3c7-b9eeaaefc7ab with Priority: HIGH for action security_group_rules [ 2942.715298] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2332c2-5aa3-4bd1-a09a-30ca9753e285 with Priority: HIGH for action port [ 2942.715361] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8d7be-8b11-4b87-8a05-b58b1f021038 with Priority: HIGH for action security_group_rules [ 2942.715723] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.715885] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.715955] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.716128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.716207] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.716367] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f95e8f-54f9-4404-ac87-211850857c49 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.716487] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f95e8f-54f9-4404-ac87-211850857c49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.716562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f95e8f-54f9-4404-ac87-211850857c49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.716761] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f95e8f-54f9-4404-ac87-211850857c49" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.716840] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f95e8f-54f9-4404-ac87-211850857c49',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.718194] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.718927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.719023] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.719180] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.719304] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.719457] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.719574] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.720645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.720645] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.720784] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.722028] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.722294] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.722643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.722820] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.722906] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.723056] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.723149] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.723217] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.723646] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ef40af-7afd-4ed0-88b3-071f1aba7488" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.723718] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ef40af-7afd-4ed0-88b3-071f1aba7488',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.725412] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.725546] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.725715] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.726111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.726197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.726344] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-00733a16-9d48-41eb-b0e1-9aaad9cc6253 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.726534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.726534] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.726668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00733a16-9d48-41eb-b0e1-9aaad9cc6253" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.727129] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.727240] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.727307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.727444] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.727523] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.727610] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00733a16-9d48-41eb-b0e1-9aaad9cc6253',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.728444] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.728586] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.728655] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.728804] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.728882] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.729023] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.729389] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.729475] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.729623] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae5a3ee1-d0c2-4c07-a368-d520fd1182a9" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.729692] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae5a3ee1-d0c2-4c07-a368-d520fd1182a9',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.730586] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.730706] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.730774] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.730944] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.731130] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.731669] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ab204b-f602-43f2-b825-e60a546adb0f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.731777] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.731849] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.731986] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.732141] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.732231] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.732299] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.732418] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.732494] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.732579] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ab204b-f602-43f2-b825-e60a546adb0f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.733728] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.733838] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.733903] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.734219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.734310] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.734454] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.734553] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.734619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.734735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2955078-2d2e-4c2d-842d-9033d2bb0ef8" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.734802] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2955078-2d2e-4c2d-842d-9033d2bb0ef8',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.735609] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.735694] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.735860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.735860] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.735984] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.736082] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0033677-0a6e-4486-8a4a-fa6c2b550528 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.736183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.736245] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.736361] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0033677-0a6e-4486-8a4a-fa6c2b550528" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.736525] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.736616] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.736681] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.736800] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.737108] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.737108] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0033677-0a6e-4486-8a4a-fa6c2b550528',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.737813] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.737929] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.737997] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.738142] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.738204] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.738347] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.738437] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.738519] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.738656] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.738798] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.738895] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.738977] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.739084] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.739158] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.739236] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.740015] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.740144] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.740210] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.740470] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.740636] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.740722] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-18832a39-e87e-45f8-beda-f4a5d65556d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.740834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.740907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.741119] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18832a39-e87e-45f8-beda-f4a5d65556d4" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.741262] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.741434] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.741513] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.741658] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.741735] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.741923] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18832a39-e87e-45f8-beda-f4a5d65556d4',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.742757] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.742869] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.742933] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.743078] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.743150] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.743292] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-41457c53-0beb-498e-9602-79d16e17cd73 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.743401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.743467] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.743567] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41457c53-0beb-498e-9602-79d16e17cd73" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.743702] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.743789] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.743852] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.743970] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.744074] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.744157] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41457c53-0beb-498e-9602-79d16e17cd73',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.745053] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.745179] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.745244] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.745396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.745465] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.745597] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5dc1b16-b068-4af0-8edb-6a8c098bd113 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.745690] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.745758] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.745942] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5dc1b16-b068-4af0-8edb-6a8c098bd113" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.746031] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.746111] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.746174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.746266] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.746330] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.746430] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5dc1b16-b068-4af0-8edb-6a8c098bd113',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.747104] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.747209] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.747274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.747414] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.747489] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.747628] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a9006-ba9f-4366-9e90-536f58fe86a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.747719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.747796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.747907] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a9006-ba9f-4366-9e90-536f58fe86a5" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.748053] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.748135] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.748197] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.748323] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.748390] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.748470] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a9006-ba9f-4366-9e90-536f58fe86a5',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.749539] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.749648] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.749714] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.749855] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.749931] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.750071] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.750152] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.750219] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.750347] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf69e81-3cbd-4cd2-b99e-b75388d904b7" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.750478] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.750562] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.750625] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.750796] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.750878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.750942] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf69e81-3cbd-4cd2-b99e-b75388d904b7',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.751918] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.752040] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.752106] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.752249] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.752320] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.752458] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.752542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.752604] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.752732] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.752795] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8a9270b-cd6f-4c8e-8912-9837cafaad4d',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.753610] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.753722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.753794] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.753930] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.754251] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.754413] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.754504] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.754644] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.754722] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.754812] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380d8c04-e2c2-437b-a0a7-c8cc0eea5c9f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.755900] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.756174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.756174] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.756313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.756313] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.756452] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563c2122-1b0a-4c12-a131-7064e7de625f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.756542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.756609] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.756867] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563c2122-1b0a-4c12-a131-7064e7de625f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.756937] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563c2122-1b0a-4c12-a131-7064e7de625f',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.757894] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.758109] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.758176] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.758324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.758401] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.758662] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.758773] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.758841] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.759065] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-334df093-4d11-4058-a3c7-b9eeaaefc7ab" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.759142] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('334df093-4d11-4058-a3c7-b9eeaaefc7ab',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.760087] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.760293] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.760359] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.760510] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.760589] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.760731] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b2332c2-5aa3-4bd1-a09a-30ca9753e285 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.760939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b2332c2-5aa3-4bd1-a09a-30ca9753e285" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.760939] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b2332c2-5aa3-4bd1-a09a-30ca9753e285" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.761239] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b2332c2-5aa3-4bd1-a09a-30ca9753e285" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.761312] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b2332c2-5aa3-4bd1-a09a-30ca9753e285',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.762180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.762289] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.762354] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.762499] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.762577] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.762721] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.762839] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.762912] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.762995] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea8d7be-8b11-4b87-8a05-b58b1f021038" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.763066] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.765879] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14f95e8f-54f9-4404-ac87-211850857c49 [ 2942.766043] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.766146] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.766322] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.766396] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.766482] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.767735] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e6ef5f-d25a-4772-b2c1-0fa446a9c4a7 [ 2942.767893] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.767989] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.768091] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.768238] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.768318] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.769279] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.769387] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.769454] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.769595] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.769668] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.769834] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.769927] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.769996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.770113] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.770183] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.770266] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ab204b-f602-43f2-b825-e60a546adb0f is going to be deleted. [ 2942.788228] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.788449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.788449] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.788682] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.788834] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.788963] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.789064] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.789128] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.789259] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.789332] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.789417] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18832a39-e87e-45f8-beda-f4a5d65556d4 is going to be deleted. [ 2942.798799] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.799148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.799148] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.799307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.799307] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.799445] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.799542] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.799611] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.799778] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.799878] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.799942] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00733a16-9d48-41eb-b0e1-9aaad9cc6253 is going to be deleted. [ 2942.809020] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae5a3ee1-d0c2-4c07-a368-d520fd1182a9 with status ACTIVE [ 2942.809248] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.809379] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.809452] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.809632] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.809719] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.809897] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.809996] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.810061] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.810200] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.810274] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.813977] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b2332c2-5aa3-4bd1-a09a-30ca9753e285 [ 2942.814170] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.814308] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.814408] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.814563] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.814642] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.820306] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2955078-2d2e-4c2d-842d-9033d2bb0ef8 with status ACTIVE [ 2942.820492] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.820615] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.820687] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.820864] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.820953] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.821132] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.821227] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.821292] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.821619] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.821764] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.828296] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea8d7be-8b11-4b87-8a05-b58b1f021038',) {} {{(pid=62156) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2942.831534] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.831748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.831748] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.832069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.832069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.832256] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.832639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.832639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.832639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.832639] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.832994] neutron-nsxv3-agent[62156]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0033677-0a6e-4486-8a4a-fa6c2b550528 is going to be deleted. [ 2942.835880] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.836069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.836069] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.836236] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.836324] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.836415] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ab204b-f602-43f2-b825-e60a546adb0f" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.840180] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.840388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.840388] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.840548] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.841546] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.841643] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.841861] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.841980] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.842130] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.842221] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.842397] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.842478] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.845126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.845280] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.845352] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.845458] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.845543] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2942.845693] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=62156) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2942.845791] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2942.845862] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2942.846045] neutron-nsxv3-agent[62156]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8a9270b-cd6f-4c8e-8912-9837cafaad4d" {{(pid=62156) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2942.846126] neutron-nsxv3-agent[62156]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>